Max level shown:
12025-01-06T20:30:02.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 79c33a4f-c8e1-4591-99af-bb9c85e074ae roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22025-01-06T20:30:02.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 79c33a4f-c8e1-4591-99af-bb9c85e074ae resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
32025-01-06T20:30:02.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 79c33a4f-c8e1-4591-99af-bb9c85e074ae response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
42025-01-06T20:30:03.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1e30c4f4-43d4-422d-8773-f21092545441 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
52025-01-06T20:30:03.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1e30c4f4-43d4-422d-8773-f21092545441 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
62025-01-06T20:30:03.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1e30c4f4-43d4-422d-8773-f21092545441 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72025-01-06T20:30:04.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 70a98334-ff0f-4efd-9b82-b9e0b6c75b75 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
82025-01-06T20:30:04.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 70a98334-ff0f-4efd-9b82-b9e0b6c75b75 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
92025-01-06T20:30:04.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 70a98334-ff0f-4efd-9b82-b9e0b6c75b75 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
102025-01-06T20:30:04.990ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
112025-01-06T20:30:04.990ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
122025-01-06T20:30:04.990ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
132025-01-06T20:30:04.990ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
142025-01-06T20:30:04.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
152025-01-06T20:30:04.990ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
162025-01-06T20:30:04.990ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
172025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
182025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
192025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
202025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
212025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
222025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
232025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
242025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
252025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
262025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
272025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
282025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
292025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
302025-01-06T20:30:04.991ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
312025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
322025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
332025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
342025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
352025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
362025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
372025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
382025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
392025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
402025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
412025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
422025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
432025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
442025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
452025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
462025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
472025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
482025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
492025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
502025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
512025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
522025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
532025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
542025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
552025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
562025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
572025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
582025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
592025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
602025-01-06T20:30:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
612025-01-06T20:30:04.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
622025-01-06T20:30:04.994ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
632025-01-06T20:30:04.995ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.77395ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
642025-01-06T20:30:04.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
652025-01-06T20:30:04.995ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
662025-01-06T20:30:04.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
672025-01-06T20:30:04.996ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 847, tv_nsec: 682923223 } })
682025-01-06T20:30:04.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
692025-01-06T20:30:04.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
702025-01-06T20:30:04.996ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
712025-01-06T20:30:04.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
722025-01-06T20:30:04.998ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
732025-01-06T20:30:04.999ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
742025-01-06T20:30:05.000ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.17671ms iteration = 4 status = {"errors":[],"finish_invoked_ok":[]}
752025-01-06T20:30:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
762025-01-06T20:30:05.000ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
772025-01-06T20:30:05.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
782025-01-06T20:30:05.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
792025-01-06T20:30:05.001ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
802025-01-06T20:30:05.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
812025-01-06T20:30:05.002ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
822025-01-06T20:30:05.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
832025-01-06T20:30:05.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
842025-01-06T20:30:05.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
852025-01-06T20:30:05.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
862025-01-06T20:30:05.007ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 847, tv_nsec: 694134649 } })
872025-01-06T20:30:05.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
882025-01-06T20:30:05.007ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
892025-01-06T20:30:05.007ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
902025-01-06T20:30:05.008ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 17.038533ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
912025-01-06T20:30:05.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
922025-01-06T20:30:05.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
932025-01-06T20:30:05.010ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
942025-01-06T20:30:05.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
952025-01-06T20:30:05.013ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
962025-01-06T20:30:05.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
972025-01-06T20:30:05.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
982025-01-06T20:30:05.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
992025-01-06T20:30:05.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1002025-01-06T20:30:05.014ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1012025-01-06T20:30:05.014ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 23.395387ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1022025-01-06T20:30:05.038ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1032025-01-06T20:30:05.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1042025-01-06T20:30:05.051ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.760874ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
1052025-01-06T20:30:05.052ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1062025-01-06T20:30:05.052ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1072025-01-06T20:30:05.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1082025-01-06T20:30:05.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1092025-01-06T20:30:05.053ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1102025-01-06T20:30:05.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1112025-01-06T20:30:05.054ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1122025-01-06T20:30:05.056ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1132025-01-06T20:30:05.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1142025-01-06T20:30:05.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1152025-01-06T20:30:05.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1162025-01-06T20:30:05.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1172025-01-06T20:30:05.057ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
1182025-01-06T20:30:05.057ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1192025-01-06T20:30:05.058ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0ee855e-7580-463b-b56b-76b59203844c", "content-length": "26", "date": "Mon, 06 Jan 2025 20:30:05 GMT"} })
1202025-01-06T20:30:05.058ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1212025-01-06T20:30:05.058ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.303112ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1222025-01-06T20:30:05.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1232025-01-06T20:30:05.059ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1242025-01-06T20:30:05.059ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1252025-01-06T20:30:05.060ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1262025-01-06T20:30:05.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1272025-01-06T20:30:05.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1282025-01-06T20:30:05.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1292025-01-06T20:30:05.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1302025-01-06T20:30:05.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1312025-01-06T20:30:05.065ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.518589ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1322025-01-06T20:30:05.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1332025-01-06T20:30:05.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1342025-01-06T20:30:05.085ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
1352025-01-06T20:30:05.085ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1362025-01-06T20:30:05.085ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a569d2f0-006e-47d3-b7e5-702716a7eec7", "content-length": "26", "date": "Mon, 06 Jan 2025 20:30:05 GMT"} })
1372025-01-06T20:30:05.085ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1382025-01-06T20:30:05.087ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
1392025-01-06T20:30:05.100ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 847, tv_nsec: 786836242 } })
1402025-01-06T20:30:05.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1412025-01-06T20:30:05.100ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
1422025-01-06T20:30:05.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1432025-01-06T20:30:05.103ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1442025-01-06T20:30:05.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1452025-01-06T20:30:05.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1462025-01-06T20:30:05.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1472025-01-06T20:30:05.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1482025-01-06T20:30:05.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
1492025-01-06T20:30:05.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1502025-01-06T20:30:05.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1512025-01-06T20:30:05.109ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 118.511816ms iteration = 4 status = 0
1522025-01-06T20:30:05.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5ab6cd3b-ecef-413d-9a86-fad279124fa9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
1532025-01-06T20:30:05.110ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1542025-01-06T20:30:05.110ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1552025-01-06T20:30:05.110ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1562025-01-06T20:30:05.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5ab6cd3b-ecef-413d-9a86-fad279124fa9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
1572025-01-06T20:30:05.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1582025-01-06T20:30:05.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5ab6cd3b-ecef-413d-9a86-fad279124fa9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
1592025-01-06T20:30:05.119ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
1602025-01-06T20:30:05.120ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe1e8161-90f6-4682-bf1c-fb1ce4ff3795", "content-length": "1", "date": "Mon, 06 Jan 2025 20:30:04 GMT"} })
1612025-01-06T20:30:05.121ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1622025-01-06T20:30:05.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1632025-01-06T20:30:05.126ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 136.187147ms iteration = 4 status = null
1642025-01-06T20:30:05.140ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 149.220962ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
1652025-01-06T20:30:05.141ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
1662025-01-06T20:30:05.141ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 150.765144ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
1672025-01-06T20:30:05.155ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1682025-01-06T20:30:05.155ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
1692025-01-06T20:30:05.155ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 164.172759ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
1702025-01-06T20:30:05.169ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1712025-01-06T20:30:05.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1722025-01-06T20:30:05.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1732025-01-06T20:30:05.172ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1742025-01-06T20:30:05.173ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1752025-01-06T20:30:05.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1762025-01-06T20:30:05.180ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
1772025-01-06T20:30:05.180ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1782025-01-06T20:30:05.180ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5e6518d-87f6-4f58-8f8f-58c45173afbe", "content-length": "26", "date": "Mon, 06 Jan 2025 20:30:05 GMT"} })
1792025-01-06T20:30:05.180ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1802025-01-06T20:30:05.181ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1812025-01-06T20:30:05.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1822025-01-06T20:30:05.202ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1832025-01-06T20:30:05.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1842025-01-06T20:30:05.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1852025-01-06T20:30:05.242ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
1862025-01-06T20:30:05.242ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1872025-01-06T20:30:05.242ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "50b08904-4398-41eb-bacd-8913e4bb03ac", "content-length": "372", "date": "Mon, 06 Jan 2025 20:30:05 GMT"} })
1882025-01-06T20:30:05.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1892025-01-06T20:30:05.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1902025-01-06T20:30:05.263ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
1912025-01-06T20:30:05.263ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
1922025-01-06T20:30:05.264ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3cd396c5-0aec-4e84-8eac-cf29340df8bd", "date": "Mon, 06 Jan 2025 20:30:05 GMT"} })
1932025-01-06T20:30:05.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1942025-01-06T20:30:05.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1952025-01-06T20:30:05.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1962025-01-06T20:30:05.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1972025-01-06T20:30:05.268ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 277.724589ms iteration = 6 status = {"physical_disks_added":0}
1982025-01-06T20:30:05.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1992025-01-06T20:30:05.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2002025-01-06T20:30:05.276ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 285.556603ms iteration = 4 status = {}
2012025-01-06T20:30:05.294ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2022025-01-06T20:30:05.295ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "735598ff-d703-48f1-8b33-2182583348c9", "content-length": "691", "date": "Mon, 06 Jan 2025 20:30:05 GMT"} })
2032025-01-06T20:30:05.295ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
2042025-01-06T20:30:05.295ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
2052025-01-06T20:30:05.295ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
2062025-01-06T20:30:05.296ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 305.346572ms iteration = 4 status = {}
2072025-01-06T20:30:05.298ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2082025-01-06T20:30:05.298ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2092025-01-06T20:30:05.298ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ad9de945-64ec-4777-9fb3-b167495c2e0f", "date": "Mon, 06 Jan 2025 20:30:05 GMT"} })
2102025-01-06T20:30:05.300ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 309.496345ms iteration = 4 status = {}
2112025-01-06T20:30:05.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2122025-01-06T20:30:05.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2132025-01-06T20:30:05.311ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
2142025-01-06T20:30:05.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2152025-01-06T20:30:05.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2162025-01-06T20:30:05.320ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2172025-01-06T20:30:05.320ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9246336e-15d2-4912-98cf-74c908cbf646", "content-length": "134", "date": "Mon, 06 Jan 2025 20:30:04 GMT"} })
2182025-01-06T20:30:05.320ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2192025-01-06T20:30:05.320ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
2202025-01-06T20:30:05.320ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2212025-01-06T20:30:05.320ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2222025-01-06T20:30:05.320ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2232025-01-06T20:30:05.320ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2242025-01-06T20:30:05.320ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2252025-01-06T20:30:05.321ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2262025-01-06T20:30:05.321ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2272025-01-06T20:30:05.321ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2282025-01-06T20:30:05.321ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
2292025-01-06T20:30:05.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2302025-01-06T20:30:05.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2312025-01-06T20:30:05.323ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2322025-01-06T20:30:05.323ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "19b649ad-f202-4910-818c-bebd9db12eb2", "content-length": "2", "date": "Mon, 06 Jan 2025 20:30:04 GMT"} })
2332025-01-06T20:30:05.323ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2342025-01-06T20:30:05.323ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "922db637-cc7b-4ad5-8a66-da3f09716437", "content-length": "52", "date": "Mon, 06 Jan 2025 20:30:04 GMT"} })
2352025-01-06T20:30:05.323ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
2362025-01-06T20:30:05.323ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2372025-01-06T20:30:05.438ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "db9b0f45-6719-4170-9589-3c68c7b3f2ab", "date": "Mon, 06 Jan 2025 20:30:05 GMT"} })
2382025-01-06T20:30:05.438ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
2392025-01-06T20:30:05.438ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2402025-01-06T20:30:05.439ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "24187233-dc94-4b06-ab99-7873f278e095", "content-length": "682", "date": "Mon, 06 Jan 2025 20:30:05 GMT"} })
2412025-01-06T20:30:05.439ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2422025-01-06T20:30:05.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2432025-01-06T20:30:05.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2442025-01-06T20:30:05.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2452025-01-06T20:30:05.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2462025-01-06T20:30:05.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2472025-01-06T20:30:05.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2482025-01-06T20:30:05.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2492025-01-06T20:30:05.460ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 469.527621ms iteration = 4 status = {}
2502025-01-06T20:30:06.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0aa5d9cf-7972-46de-835f-960f94278e03 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2512025-01-06T20:30:06.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0aa5d9cf-7972-46de-835f-960f94278e03 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2522025-01-06T20:30:06.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0aa5d9cf-7972-46de-835f-960f94278e03 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2532025-01-06T20:30:07.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 91f02b15-b34d-48b0-bb31-75e87c91af3c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2542025-01-06T20:30:07.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 91f02b15-b34d-48b0-bb31-75e87c91af3c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2552025-01-06T20:30:07.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 91f02b15-b34d-48b0-bb31-75e87c91af3c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2562025-01-06T20:30:07.764ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 575 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 04061fb9-67be-4ff4-bf1f-81502f8c6c06 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
2572025-01-06T20:30:08.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e2731750-1545-479c-b659-55dfe6dc84ae roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2582025-01-06T20:30:08.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e2731750-1545-479c-b659-55dfe6dc84ae resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2592025-01-06T20:30:08.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e2731750-1545-479c-b659-55dfe6dc84ae response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2602025-01-06T20:30:09.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bd3b9b87-943d-4134-9060-d1ce4c2c6150 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2612025-01-06T20:30:09.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bd3b9b87-943d-4134-9060-d1ce4c2c6150 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2622025-01-06T20:30:09.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bd3b9b87-943d-4134-9060-d1ce4c2c6150 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2632025-01-06T20:30:10.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 44b3f34f-730a-46f2-8f3a-9a342f9660f4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2642025-01-06T20:30:10.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 44b3f34f-730a-46f2-8f3a-9a342f9660f4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2652025-01-06T20:30:10.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 44b3f34f-730a-46f2-8f3a-9a342f9660f4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2662025-01-06T20:30:11.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 59f9efbd-f192-428c-b267-a98fbd69e59e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2672025-01-06T20:30:11.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 59f9efbd-f192-428c-b267-a98fbd69e59e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2682025-01-06T20:30:11.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 59f9efbd-f192-428c-b267-a98fbd69e59e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2692025-01-06T20:30:12.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0bb8a9e8-f656-4f73-a621-36961677d89f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2702025-01-06T20:30:12.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0bb8a9e8-f656-4f73-a621-36961677d89f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2712025-01-06T20:30:12.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0bb8a9e8-f656-4f73-a621-36961677d89f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2722025-01-06T20:30:13.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f6ff5089-3627-4213-9ec9-44b864ea45c9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2732025-01-06T20:30:13.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f6ff5089-3627-4213-9ec9-44b864ea45c9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2742025-01-06T20:30:13.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1915 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f6ff5089-3627-4213-9ec9-44b864ea45c9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2752025-01-06T20:30:14.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cbf0d478-af42-42be-bee6-465f4753d3c2 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2762025-01-06T20:30:14.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cbf0d478-af42-42be-bee6-465f4753d3c2 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2772025-01-06T20:30:14.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cbf0d478-af42-42be-bee6-465f4753d3c2 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
2782025-01-06T20:30:14.990ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
2792025-01-06T20:30:14.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2802025-01-06T20:30:14.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2812025-01-06T20:30:14.991ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
2822025-01-06T20:30:14.991ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2832025-01-06T20:30:14.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2842025-01-06T20:30:14.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2852025-01-06T20:30:14.992ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2862025-01-06T20:30:14.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2872025-01-06T20:30:14.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2882025-01-06T20:30:14.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2892025-01-06T20:30:14.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2902025-01-06T20:30:14.994ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.67718ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2912025-01-06T20:30:14.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2922025-01-06T20:30:14.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2932025-01-06T20:30:14.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2942025-01-06T20:30:15.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
2952025-01-06T20:30:15.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2962025-01-06T20:30:15.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2972025-01-06T20:30:15.010ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
2982025-01-06T20:30:15.010ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.113918ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
2992025-01-06T20:30:15.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 98205774-0e0d-4409-bfa7-faa774ca2e22 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3002025-01-06T20:30:15.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 98205774-0e0d-4409-bfa7-faa774ca2e22 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3012025-01-06T20:30:15.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 98205774-0e0d-4409-bfa7-faa774ca2e22 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3022025-01-06T20:30:16.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 483a17f6-d017-4eea-b6ed-a0df17f7506a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3032025-01-06T20:30:16.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 483a17f6-d017-4eea-b6ed-a0df17f7506a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3042025-01-06T20:30:16.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 483a17f6-d017-4eea-b6ed-a0df17f7506a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3052025-01-06T20:30:17.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 893cd210-e4dc-4ce3-accf-cb9aad01c676 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3062025-01-06T20:30:17.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 893cd210-e4dc-4ce3-accf-cb9aad01c676 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3072025-01-06T20:30:17.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 893cd210-e4dc-4ce3-accf-cb9aad01c676 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3082025-01-06T20:30:17.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = c1f259e1-aae1-45d3-b849-55263296e70e roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
3092025-01-06T20:30:17.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = c1f259e1-aae1-45d3-b849-55263296e70e resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
3102025-01-06T20:30:17.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = c1f259e1-aae1-45d3-b849-55263296e70e response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
3112025-01-06T20:30:17.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 4032d380-c595-40d0-92c5-3f440510a782 roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
3122025-01-06T20:30:17.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 4032d380-c595-40d0-92c5-3f440510a782 resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
3132025-01-06T20:30:17.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3503 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 4032d380-c595-40d0-92c5-3f440510a782 response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
3142025-01-06T20:30:17.764ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 448 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 2c499fe8-ff30-4fc5-a35a-e9052ea9e6c0 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
3152025-01-06T20:30:18.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 358da3c5-d9f7-4178-8dbe-162f93745cb0 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3162025-01-06T20:30:18.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 358da3c5-d9f7-4178-8dbe-162f93745cb0 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3172025-01-06T20:30:18.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 358da3c5-d9f7-4178-8dbe-162f93745cb0 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3182025-01-06T20:30:19.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a6fc067f-b088-494a-96b0-0b50cedbf107 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3192025-01-06T20:30:19.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a6fc067f-b088-494a-96b0-0b50cedbf107 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3202025-01-06T20:30:19.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a6fc067f-b088-494a-96b0-0b50cedbf107 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3212025-01-06T20:30:20.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4aa59bd2-ed52-4e8c-aaf8-555ab23f17d1 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3222025-01-06T20:30:20.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4aa59bd2-ed52-4e8c-aaf8-555ab23f17d1 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3232025-01-06T20:30:20.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4aa59bd2-ed52-4e8c-aaf8-555ab23f17d1 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3242025-01-06T20:30:21.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1644060b-65ec-4817-8ce7-c1f0e836f821 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3252025-01-06T20:30:21.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1644060b-65ec-4817-8ce7-c1f0e836f821 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3262025-01-06T20:30:21.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1644060b-65ec-4817-8ce7-c1f0e836f821 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3272025-01-06T20:30:22.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3e48693a-904c-498d-a52e-66c1a3dcc076 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3282025-01-06T20:30:22.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3e48693a-904c-498d-a52e-66c1a3dcc076 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3292025-01-06T20:30:22.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3e48693a-904c-498d-a52e-66c1a3dcc076 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3302025-01-06T20:30:23.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 01507035-98c3-4ba2-8326-43f4953843db roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3312025-01-06T20:30:23.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 01507035-98c3-4ba2-8326-43f4953843db resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3322025-01-06T20:30:23.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 01507035-98c3-4ba2-8326-43f4953843db response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3332025-01-06T20:30:24.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3801abce-d46b-4a8c-9203-5de482965da2 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3342025-01-06T20:30:24.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3801abce-d46b-4a8c-9203-5de482965da2 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3352025-01-06T20:30:24.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3801abce-d46b-4a8c-9203-5de482965da2 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3362025-01-06T20:30:24.989ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
3372025-01-06T20:30:24.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3382025-01-06T20:30:24.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3392025-01-06T20:30:24.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3402025-01-06T20:30:24.991ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
3412025-01-06T20:30:24.991ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3422025-01-06T20:30:24.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3432025-01-06T20:30:24.992ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3442025-01-06T20:30:24.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3452025-01-06T20:30:24.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3462025-01-06T20:30:24.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3472025-01-06T20:30:24.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3482025-01-06T20:30:24.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3492025-01-06T20:30:24.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3502025-01-06T20:30:24.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3512025-01-06T20:30:24.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
3522025-01-06T20:30:24.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3532025-01-06T20:30:24.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3542025-01-06T20:30:25.015ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
3552025-01-06T20:30:25.015ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.453273ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
3562025-01-06T20:30:25.024ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.951387ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3572025-01-06T20:30:25.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c8b02da9-2d2f-4cee-9797-40cb5a3b0ee1 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3582025-01-06T20:30:25.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c8b02da9-2d2f-4cee-9797-40cb5a3b0ee1 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3592025-01-06T20:30:25.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2583 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c8b02da9-2d2f-4cee-9797-40cb5a3b0ee1 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3602025-01-06T20:30:26.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d3626278-dc8d-4f1b-98b2-12ca7b3e09d3 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3612025-01-06T20:30:26.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d3626278-dc8d-4f1b-98b2-12ca7b3e09d3 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3622025-01-06T20:30:26.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d3626278-dc8d-4f1b-98b2-12ca7b3e09d3 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3632025-01-06T20:30:27.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c805127d-5c73-45c8-86a5-1205b965c90c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3642025-01-06T20:30:27.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c805127d-5c73-45c8-86a5-1205b965c90c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3652025-01-06T20:30:27.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2697 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c805127d-5c73-45c8-86a5-1205b965c90c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3662025-01-06T20:30:27.764ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 519 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 3a8a304b-8808-441c-aa0c-6a6542e66870 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
3672025-01-06T20:30:28.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b986e75e-2807-4c09-9758-54c9bbe7f666 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3682025-01-06T20:30:28.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b986e75e-2807-4c09-9758-54c9bbe7f666 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3692025-01-06T20:30:28.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b986e75e-2807-4c09-9758-54c9bbe7f666 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3702025-01-06T20:30:29.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 71f709e9-bd96-4e5d-bc48-b18c21328a25 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3712025-01-06T20:30:29.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 71f709e9-bd96-4e5d-bc48-b18c21328a25 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3722025-01-06T20:30:29.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 71f709e9-bd96-4e5d-bc48-b18c21328a25 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3732025-01-06T20:30:30.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a0161813-ccb9-4946-8a4b-d2dacaa72377 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3742025-01-06T20:30:30.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a0161813-ccb9-4946-8a4b-d2dacaa72377 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3752025-01-06T20:30:30.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a0161813-ccb9-4946-8a4b-d2dacaa72377 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3762025-01-06T20:30:31.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dc202d5e-40ad-464c-805e-44bc2b857ff2 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3772025-01-06T20:30:31.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dc202d5e-40ad-464c-805e-44bc2b857ff2 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3782025-01-06T20:30:31.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dc202d5e-40ad-464c-805e-44bc2b857ff2 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3792025-01-06T20:30:32.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 300694ad-fbd4-4b0d-a5bf-c6970c8c5796 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3802025-01-06T20:30:32.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 300694ad-fbd4-4b0d-a5bf-c6970c8c5796 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3812025-01-06T20:30:32.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 300694ad-fbd4-4b0d-a5bf-c6970c8c5796 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3822025-01-06T20:30:33.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4f8fb159-18af-4f69-9537-68ec4324c6a2 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3832025-01-06T20:30:33.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4f8fb159-18af-4f69-9537-68ec4324c6a2 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3842025-01-06T20:30:33.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4f8fb159-18af-4f69-9537-68ec4324c6a2 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3852025-01-06T20:30:34.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ed1402d6-5626-402d-9b17-258d3d592829 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3862025-01-06T20:30:34.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ed1402d6-5626-402d-9b17-258d3d592829 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3872025-01-06T20:30:34.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ed1402d6-5626-402d-9b17-258d3d592829 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
3882025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
3892025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
3902025-01-06T20:30:34.990ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-06 20:20:34.990299267 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
3912025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
3922025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
3932025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
3942025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3952025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
3962025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
3972025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3982025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
3992025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4002025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
4012025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
4022025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
4032025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
4042025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4052025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4062025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
4072025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4082025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
4092025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4102025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
4112025-01-06T20:30:34.990ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468
4122025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.741\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468"}
4132025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
4142025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4152025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
4162025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
4172025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4182025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4192025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
4202025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4212025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
4222025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
4232025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4242025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4252025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
4262025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
4272025-01-06T20:30:34.990ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4282025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4292025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4302025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
4312025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4322025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4332025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
4342025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4352025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
4362025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4372025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
4382025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
4392025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4402025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4412025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
4422025-01-06T20:30:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4432025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
4442025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4452025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4462025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
4472025-01-06T20:30:34.991ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4482025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4492025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4502025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
4512025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4522025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4532025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4542025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4552025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4562025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4572025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4582025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4592025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
4602025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4612025-01-06T20:30:34.991ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65bacdd1-9837-48ad-941c-aec5e2d79006.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 877, tv_nsec: 678033380 } })
4622025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4632025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4642025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4652025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4662025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4672025-01-06T20:30:34.991ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("88aaaee6-38b4-4a83-9c08-04f0ea18e003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8dd67555-06fb-4cef-b914-9650f0eeb68a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 877, tv_nsec: 678099382 } })
4682025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4692025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4702025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4712025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4722025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4732025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4742025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4752025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4762025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
4772025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.171592ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4782025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
4792025-01-06T20:30:34.991ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.48114ms iteration = 3 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
4802025-01-06T20:30:34.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4812025-01-06T20:30:34.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4822025-01-06T20:30:34.993ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-06 20:20:34.990299267 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
4832025-01-06T20:30:34.993ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.426143ms iteration = 3 status = {"expiration":"2025-01-06T20:20:34.990299267Z","pruned":[]}
4842025-01-06T20:30:34.994ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.644869ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4852025-01-06T20:30:34.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4862025-01-06T20:30:34.994ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 877, tv_nsec: 681332790 } })
4872025-01-06T20:30:34.994ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4882025-01-06T20:30:34.994ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
4892025-01-06T20:30:34.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4902025-01-06T20:30:34.995ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4912025-01-06T20:30:34.995ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 877, tv_nsec: 682821491 } })
4922025-01-06T20:30:34.996ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.655845ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
4932025-01-06T20:30:34.996ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
4942025-01-06T20:30:34.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4952025-01-06T20:30:34.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4962025-01-06T20:30:34.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4972025-01-06T20:30:34.998ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4982025-01-06T20:30:34.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
4992025-01-06T20:30:34.998ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5002025-01-06T20:30:34.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5012025-01-06T20:30:34.998ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.323096ms iteration = 5 status = {"errors":[],"finish_invoked_ok":[]}
5022025-01-06T20:30:34.999ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5032025-01-06T20:30:34.999ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5042025-01-06T20:30:34.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5052025-01-06T20:30:35.004ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5062025-01-06T20:30:35.005ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.879665ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
5072025-01-06T20:30:35.005ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5082025-01-06T20:30:35.007ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5092025-01-06T20:30:35.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5102025-01-06T20:30:35.007ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5112025-01-06T20:30:35.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5122025-01-06T20:30:35.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5132025-01-06T20:30:35.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5142025-01-06T20:30:35.007ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5152025-01-06T20:30:35.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5162025-01-06T20:30:35.008ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5172025-01-06T20:30:35.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5182025-01-06T20:30:35.012ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5192025-01-06T20:30:35.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5202025-01-06T20:30:35.015ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5212025-01-06T20:30:35.018ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.17735ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5222025-01-06T20:30:35.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5232025-01-06T20:30:35.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5242025-01-06T20:30:35.018ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5252025-01-06T20:30:35.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5262025-01-06T20:30:35.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5272025-01-06T20:30:35.018ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5282025-01-06T20:30:35.018ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 877, tv_nsec: 705715364 } })
5292025-01-06T20:30:35.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5302025-01-06T20:30:35.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5312025-01-06T20:30:35.019ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
5322025-01-06T20:30:35.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5332025-01-06T20:30:35.020ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
5342025-01-06T20:30:35.020ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 29.828761ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
5352025-01-06T20:30:35.021ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5362025-01-06T20:30:35.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5372025-01-06T20:30:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5382025-01-06T20:30:35.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
5392025-01-06T20:30:35.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5402025-01-06T20:30:35.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5412025-01-06T20:30:35.024ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5422025-01-06T20:30:35.027ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5432025-01-06T20:30:35.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5442025-01-06T20:30:35.027ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5452025-01-06T20:30:35.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5462025-01-06T20:30:35.031ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5472025-01-06T20:30:35.031ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5482025-01-06T20:30:35.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5492025-01-06T20:30:35.063ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
5502025-01-06T20:30:35.063ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.173452ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
5512025-01-06T20:30:35.074ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5522025-01-06T20:30:35.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5532025-01-06T20:30:35.075ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5542025-01-06T20:30:35.075ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5552025-01-06T20:30:35.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5562025-01-06T20:30:35.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5572025-01-06T20:30:35.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5582025-01-06T20:30:35.082ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5592025-01-06T20:30:35.082ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5602025-01-06T20:30:35.082ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5612025-01-06T20:30:35.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5622025-01-06T20:30:35.084ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.545386ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
5632025-01-06T20:30:35.084ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5642025-01-06T20:30:35.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5652025-01-06T20:30:35.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5662025-01-06T20:30:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5672025-01-06T20:30:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5682025-01-06T20:30:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5692025-01-06T20:30:35.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5702025-01-06T20:30:35.086ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5712025-01-06T20:30:35.086ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5722025-01-06T20:30:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 95.359075ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5732025-01-06T20:30:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5742025-01-06T20:30:35.087ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
5752025-01-06T20:30:35.087ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
5762025-01-06T20:30:35.087ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
5772025-01-06T20:30:35.087ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5782025-01-06T20:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5792025-01-06T20:30:35.088ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5802025-01-06T20:30:35.088ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
5812025-01-06T20:30:35.088ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5822025-01-06T20:30:35.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5832025-01-06T20:30:35.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5842025-01-06T20:30:35.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5852025-01-06T20:30:35.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5862025-01-06T20:30:35.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5872025-01-06T20:30:35.092ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5882025-01-06T20:30:35.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5892025-01-06T20:30:35.092ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5902025-01-06T20:30:35.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5912025-01-06T20:30:35.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5922025-01-06T20:30:35.092ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5932025-01-06T20:30:35.093ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-06T20:28:32.843602Z, time_modified: 2025-01-06T20:28:32.843602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }) }
5942025-01-06T20:30:35.093ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 102.919962ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]}},"default_endpoint":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
5952025-01-06T20:30:35.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5962025-01-06T20:30:35.095ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5972025-01-06T20:30:35.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5982025-01-06T20:30:35.107ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
5992025-01-06T20:30:35.135ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6002025-01-06T20:30:35.135ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6012025-01-06T20:30:35.135ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6022025-01-06T20:30:35.135ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6032025-01-06T20:30:35.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6042025-01-06T20:30:35.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6052025-01-06T20:30:35.138ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6062025-01-06T20:30:35.138ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6072025-01-06T20:30:35.138ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 148.030249ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6082025-01-06T20:30:35.141ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6092025-01-06T20:30:35.141ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 151.091753ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6102025-01-06T20:30:35.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6112025-01-06T20:30:35.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6122025-01-06T20:30:35.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6132025-01-06T20:30:35.143ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 153.17824ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
6142025-01-06T20:30:35.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6152025-01-06T20:30:35.144ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6162025-01-06T20:30:35.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6172025-01-06T20:30:35.153ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6182025-01-06T20:30:35.153ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6192025-01-06T20:30:35.153ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 162.721079ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6202025-01-06T20:30:35.154ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
6212025-01-06T20:30:35.154ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6222025-01-06T20:30:35.154ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5578a2b2-f05d-46e0-8829-d8c78b4cf9d3", "content-length": "26", "date": "Mon, 06 Jan 2025 20:30:35 GMT"} })
6232025-01-06T20:30:35.154ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6242025-01-06T20:30:35.156ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
6252025-01-06T20:30:35.159ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
6262025-01-06T20:30:35.159ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 169.065422ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
6272025-01-06T20:30:35.176ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 185.340235ms iteration = 7 status = {"physical_disks_added":0}
6282025-01-06T20:30:35.178ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6292025-01-06T20:30:35.178ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6302025-01-06T20:30:35.178ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b770935-5c2f-4db5-8244-782b6841dcee", "content-length": "26", "date": "Mon, 06 Jan 2025 20:30:35 GMT"} })
6312025-01-06T20:30:35.178ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6322025-01-06T20:30:35.180ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6332025-01-06T20:30:35.182ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6342025-01-06T20:30:35.182ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6352025-01-06T20:30:35.182ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7b0fb44-ef47-4dbb-8bbe-9c75617ade7f", "content-length": "26", "date": "Mon, 06 Jan 2025 20:30:35 GMT"} })
6362025-01-06T20:30:35.182ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6372025-01-06T20:30:35.183ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6382025-01-06T20:30:35.184ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6392025-01-06T20:30:35.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6402025-01-06T20:30:35.215ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
6412025-01-06T20:30:35.303ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
6422025-01-06T20:30:35.355ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6432025-01-06T20:30:35.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6442025-01-06T20:30:35.372ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6452025-01-06T20:30:35.373ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7665030-a284-4f06-8566-b85b9873348a", "content-length": "1", "date": "Mon, 06 Jan 2025 20:30:34 GMT"} })
6462025-01-06T20:30:35.374ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6472025-01-06T20:30:35.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6482025-01-06T20:30:35.375ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 385.043441ms iteration = 5 status = {}
6492025-01-06T20:30:35.410ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
6502025-01-06T20:30:35.410ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
6512025-01-06T20:30:35.410ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfb2e9b8-b5f2-457d-b504-52cc8e148bcc", "content-length": "372", "date": "Mon, 06 Jan 2025 20:30:35 GMT"} })
6522025-01-06T20:30:35.410ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6532025-01-06T20:30:35.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6542025-01-06T20:30:35.419ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6552025-01-06T20:30:35.420ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 429.717017ms iteration = 5 status = null
6562025-01-06T20:30:35.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6572025-01-06T20:30:35.421ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6582025-01-06T20:30:35.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
6592025-01-06T20:30:35.425ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6602025-01-06T20:30:35.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6612025-01-06T20:30:35.427ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 436.615515ms iteration = 5 status = 0
6622025-01-06T20:30:35.434ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
6632025-01-06T20:30:35.435ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "99183267-4f1f-43d9-832f-2894c2087240", "date": "Mon, 06 Jan 2025 20:30:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
6642025-01-06T20:30:35.435ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
6652025-01-06T20:30:35.437ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6633a681-356d-4667-9b7b-629faeae04d0", "date": "Mon, 06 Jan 2025 20:30:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
6662025-01-06T20:30:35.437ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
6672025-01-06T20:30:35.438ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "10ae5e61-4a15-4a67-95b4-0cb162c55478", "date": "Mon, 06 Jan 2025 20:30:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
6682025-01-06T20:30:35.438ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
6692025-01-06T20:30:35.440ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
6702025-01-06T20:30:35.440ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 450.539694ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
6712025-01-06T20:30:35.443ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
6722025-01-06T20:30:35.443ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a995cd9c-ee16-47f4-ba4a-2b911548c984", "date": "Mon, 06 Jan 2025 20:30:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
6732025-01-06T20:30:35.443ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
6742025-01-06T20:30:35.443ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
6752025-01-06T20:30:35.443ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
6762025-01-06T20:30:35.443ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6772025-01-06T20:30:35.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6782025-01-06T20:30:35.445ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0315802e-3525-4349-8f55-90df24ce1c14", "date": "Mon, 06 Jan 2025 20:30:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
6792025-01-06T20:30:35.445ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
6802025-01-06T20:30:35.446ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6812025-01-06T20:30:35.446ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
6822025-01-06T20:30:35.446ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 456.469515ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
6832025-01-06T20:30:35.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6842025-01-06T20:30:35.448ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6852025-01-06T20:30:35.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6862025-01-06T20:30:35.451ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
6872025-01-06T20:30:35.451ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
6882025-01-06T20:30:35.451ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-06 20:28:35.848690 UTC dns_group = internal generation = 1
6892025-01-06T20:30:35.451ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 460.856865ms iteration = 3 status = {"generation":1}
6902025-01-06T20:30:35.453ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
6912025-01-06T20:30:35.453ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 0 version = 2
6922025-01-06T20:30:35.453ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6932025-01-06T20:30:35.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6942025-01-06T20:30:35.458ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6952025-01-06T20:30:35.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6962025-01-06T20:30:35.461ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6972025-01-06T20:30:35.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6982025-01-06T20:30:35.463ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 1 version = 2
6992025-01-06T20:30:35.463ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7002025-01-06T20:30:35.463ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-06 20:28:37.181288 UTC dns_group = external generation = 2
7012025-01-06T20:30:35.463ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 473.16637ms iteration = 3 status = {"generation":2}
7022025-01-06T20:30:35.468ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7032025-01-06T20:30:35.468ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7042025-01-06T20:30:35.468ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "082566a3-2f49-486a-af21-196d2c893b78", "date": "Mon, 06 Jan 2025 20:30:35 GMT"} })
7052025-01-06T20:30:35.468ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7062025-01-06T20:30:35.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7072025-01-06T20:30:35.471ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7082025-01-06T20:30:35.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7092025-01-06T20:30:35.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7102025-01-06T20:30:35.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7112025-01-06T20:30:35.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7122025-01-06T20:30:35.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7132025-01-06T20:30:35.477ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
7142025-01-06T20:30:35.477ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7152025-01-06T20:30:35.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7162025-01-06T20:30:35.478ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7172025-01-06T20:30:35.478ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7182025-01-06T20:30:35.478ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9804341f-33bb-4ebf-b28b-1244a1342e7e", "date": "Mon, 06 Jan 2025 20:30:35 GMT"} })
7192025-01-06T20:30:35.480ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 490.056529ms iteration = 5 status = {}
7202025-01-06T20:30:35.489ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
7212025-01-06T20:30:35.489ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdaa0b69-5c5b-4bfb-8c91-6652a4a34b58", "content-length": "134", "date": "Mon, 06 Jan 2025 20:30:35 GMT"} })
7222025-01-06T20:30:35.489ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
7232025-01-06T20:30:35.489ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
7242025-01-06T20:30:35.489ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
7252025-01-06T20:30:35.489ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
7262025-01-06T20:30:35.489ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7272025-01-06T20:30:35.489ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7282025-01-06T20:30:35.489ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7292025-01-06T20:30:35.489ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7302025-01-06T20:30:35.490ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7312025-01-06T20:30:35.490ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7322025-01-06T20:30:35.490ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
7332025-01-06T20:30:35.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7342025-01-06T20:30:35.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7352025-01-06T20:30:35.492ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
7362025-01-06T20:30:35.492ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b6ee63c-7476-4208-affc-a9c093decce3", "content-length": "2", "date": "Mon, 06 Jan 2025 20:30:35 GMT"} })
7372025-01-06T20:30:35.492ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
7382025-01-06T20:30:35.492ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d71e425e-6444-4700-b0f0-59f7e77c3207", "content-length": "52", "date": "Mon, 06 Jan 2025 20:30:35 GMT"} })
7392025-01-06T20:30:35.492ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
7402025-01-06T20:30:35.492ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
7412025-01-06T20:30:35.538ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7422025-01-06T20:30:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7432025-01-06T20:30:35.539ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7442025-01-06T20:30:35.541ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7452025-01-06T20:30:35.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7462025-01-06T20:30:35.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7472025-01-06T20:30:35.543ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7482025-01-06T20:30:35.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7492025-01-06T20:30:35.545ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7502025-01-06T20:30:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7512025-01-06T20:30:35.607ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bfe26397-cc91-42f2-8637-20fc2122f873", "date": "Mon, 06 Jan 2025 20:30:35 GMT"} })
7522025-01-06T20:30:35.607ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
7532025-01-06T20:30:35.607ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
7542025-01-06T20:30:35.608ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "457a3560-3b02-473f-972d-cf439ec9e481", "content-length": "682", "date": "Mon, 06 Jan 2025 20:30:35 GMT"} })
7552025-01-06T20:30:35.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7562025-01-06T20:30:35.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7572025-01-06T20:30:35.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7582025-01-06T20:30:35.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7592025-01-06T20:30:35.619ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7602025-01-06T20:30:35.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7612025-01-06T20:30:35.622ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7622025-01-06T20:30:35.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7632025-01-06T20:30:35.630ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 639.638151ms iteration = 5 status = {}
7642025-01-06T20:30:35.643ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7652025-01-06T20:30:35.643ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2aa36635-a066-408a-be03-4fb66fbab4b8", "content-length": "691", "date": "Mon, 06 Jan 2025 20:30:35 GMT"} })
7662025-01-06T20:30:35.643ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
7672025-01-06T20:30:35.643ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
7682025-01-06T20:30:35.643ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
7692025-01-06T20:30:35.643ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 653.361245ms iteration = 5 status = {}
7702025-01-06T20:30:35.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 846441a0-9f0d-40ba-b3aa-6b8e345fa0f9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7712025-01-06T20:30:35.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 846441a0-9f0d-40ba-b3aa-6b8e345fa0f9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7722025-01-06T20:30:35.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 846441a0-9f0d-40ba-b3aa-6b8e345fa0f9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7732025-01-06T20:30:36.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bc95a26a-39a1-40cc-9d13-843f98fd163f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7742025-01-06T20:30:36.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bc95a26a-39a1-40cc-9d13-843f98fd163f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7752025-01-06T20:30:36.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bc95a26a-39a1-40cc-9d13-843f98fd163f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7762025-01-06T20:30:37.764ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 588 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 13c214fa-93a4-44da-9db9-1addd5f876ef response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
7772025-01-06T20:30:37.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7f425da6-093e-4aa2-8469-edde3e8c7d70 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7782025-01-06T20:30:37.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7f425da6-093e-4aa2-8469-edde3e8c7d70 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7792025-01-06T20:30:37.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7f425da6-093e-4aa2-8469-edde3e8c7d70 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7802025-01-06T20:30:38.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b1669374-6e67-45bb-b1c8-c4ed1900d399 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7812025-01-06T20:30:38.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b1669374-6e67-45bb-b1c8-c4ed1900d399 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7822025-01-06T20:30:38.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b1669374-6e67-45bb-b1c8-c4ed1900d399 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7832025-01-06T20:30:39.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6974a99b-9cfb-4d37-89bd-70c3185c97ea roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7842025-01-06T20:30:39.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6974a99b-9cfb-4d37-89bd-70c3185c97ea resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7852025-01-06T20:30:39.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6974a99b-9cfb-4d37-89bd-70c3185c97ea response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7862025-01-06T20:30:40.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 57925ccc-777c-46ef-97a8-d71e812285de roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7872025-01-06T20:30:40.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 57925ccc-777c-46ef-97a8-d71e812285de resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7882025-01-06T20:30:40.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 57925ccc-777c-46ef-97a8-d71e812285de response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7892025-01-06T20:30:41.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 341a8f29-b50c-4842-955e-6c173feaa4a8 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7902025-01-06T20:30:41.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 341a8f29-b50c-4842-955e-6c173feaa4a8 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7912025-01-06T20:30:41.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 341a8f29-b50c-4842-955e-6c173feaa4a8 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7922025-01-06T20:30:42.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 370bdeea-5dbe-4cdf-b8cf-769098a551f6 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7932025-01-06T20:30:42.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 370bdeea-5dbe-4cdf-b8cf-769098a551f6 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7942025-01-06T20:30:42.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 370bdeea-5dbe-4cdf-b8cf-769098a551f6 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7952025-01-06T20:30:43.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 73f0b447-05fb-42c7-ab3b-7a8edcef16ff roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7962025-01-06T20:30:43.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 73f0b447-05fb-42c7-ab3b-7a8edcef16ff resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7972025-01-06T20:30:43.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 73f0b447-05fb-42c7-ab3b-7a8edcef16ff response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7982025-01-06T20:30:44.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 85a624c0-f730-4fbf-8682-89bed72fd300 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
7992025-01-06T20:30:44.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 85a624c0-f730-4fbf-8682-89bed72fd300 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8002025-01-06T20:30:44.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 85a624c0-f730-4fbf-8682-89bed72fd300 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8012025-01-06T20:30:44.990ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
8022025-01-06T20:30:44.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8032025-01-06T20:30:44.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8042025-01-06T20:30:44.990ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
8052025-01-06T20:30:44.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8062025-01-06T20:30:44.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8072025-01-06T20:30:44.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8082025-01-06T20:30:44.992ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8092025-01-06T20:30:44.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8102025-01-06T20:30:44.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8112025-01-06T20:30:44.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8122025-01-06T20:30:44.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8132025-01-06T20:30:44.994ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.664009ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8142025-01-06T20:30:44.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8152025-01-06T20:30:44.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8162025-01-06T20:30:44.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8172025-01-06T20:30:44.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
8182025-01-06T20:30:44.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8192025-01-06T20:30:44.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8202025-01-06T20:30:45.011ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
8212025-01-06T20:30:45.011ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.998862ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
8222025-01-06T20:30:45.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f0435844-c279-4a86-808b-8ec4d2ef2044 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8232025-01-06T20:30:45.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f0435844-c279-4a86-808b-8ec4d2ef2044 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8242025-01-06T20:30:45.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f0435844-c279-4a86-808b-8ec4d2ef2044 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8252025-01-06T20:30:47.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cf9ed524-8254-42a1-b858-62ed6c2d8256 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8262025-01-06T20:30:47.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cf9ed524-8254-42a1-b858-62ed6c2d8256 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8272025-01-06T20:30:47.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cf9ed524-8254-42a1-b858-62ed6c2d8256 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8282025-01-06T20:30:47.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 559 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 3ac48747-c58f-4310-ba1d-155cebf3be20 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
8292025-01-06T20:30:48.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1e7b8bf4-c6fd-41f4-aa0e-51cd2ef890ce roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8302025-01-06T20:30:48.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1e7b8bf4-c6fd-41f4-aa0e-51cd2ef890ce resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8312025-01-06T20:30:48.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1e7b8bf4-c6fd-41f4-aa0e-51cd2ef890ce response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8322025-01-06T20:30:49.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 09984298-e71a-4021-bb6c-e4658105ae4a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8332025-01-06T20:30:49.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 09984298-e71a-4021-bb6c-e4658105ae4a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8342025-01-06T20:30:49.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 09984298-e71a-4021-bb6c-e4658105ae4a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8352025-01-06T20:30:50.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 147b4f9a-3cbf-4648-9d08-720e42de6b1f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8362025-01-06T20:30:50.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 147b4f9a-3cbf-4648-9d08-720e42de6b1f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8372025-01-06T20:30:50.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 147b4f9a-3cbf-4648-9d08-720e42de6b1f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8382025-01-06T20:30:51.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fb4da66b-d064-4ed2-8dfe-095ccbf9c8e3 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8392025-01-06T20:30:51.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fb4da66b-d064-4ed2-8dfe-095ccbf9c8e3 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8402025-01-06T20:30:51.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fb4da66b-d064-4ed2-8dfe-095ccbf9c8e3 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8412025-01-06T20:30:52.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = da04ebc5-7b58-4e55-8941-64ad77e30de9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8422025-01-06T20:30:52.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = da04ebc5-7b58-4e55-8941-64ad77e30de9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8432025-01-06T20:30:52.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = da04ebc5-7b58-4e55-8941-64ad77e30de9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8442025-01-06T20:30:53.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4543d1e0-3809-4946-abaa-b39502b3f29f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8452025-01-06T20:30:53.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4543d1e0-3809-4946-abaa-b39502b3f29f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8462025-01-06T20:30:53.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4543d1e0-3809-4946-abaa-b39502b3f29f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8472025-01-06T20:30:54.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 405bf88d-ccea-4a9f-98b3-f29a64acde5a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8482025-01-06T20:30:54.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 405bf88d-ccea-4a9f-98b3-f29a64acde5a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8492025-01-06T20:30:54.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 405bf88d-ccea-4a9f-98b3-f29a64acde5a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8502025-01-06T20:30:54.990ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
8512025-01-06T20:30:54.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8522025-01-06T20:30:54.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8532025-01-06T20:30:54.990ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
8542025-01-06T20:30:54.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8552025-01-06T20:30:54.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8562025-01-06T20:30:54.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8572025-01-06T20:30:54.992ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8582025-01-06T20:30:54.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8592025-01-06T20:30:54.994ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.628329ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8602025-01-06T20:30:54.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8612025-01-06T20:30:54.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8622025-01-06T20:30:54.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8632025-01-06T20:30:54.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8642025-01-06T20:30:54.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8652025-01-06T20:30:54.998ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8662025-01-06T20:30:55.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
8672025-01-06T20:30:55.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8682025-01-06T20:30:55.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8692025-01-06T20:30:55.009ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
8702025-01-06T20:30:55.009ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.81531ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
8712025-01-06T20:30:55.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c97c1716-25af-4ebe-8d18-7b5c0565f2c6 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8722025-01-06T20:30:55.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c97c1716-25af-4ebe-8d18-7b5c0565f2c6 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8732025-01-06T20:30:55.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1768 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c97c1716-25af-4ebe-8d18-7b5c0565f2c6 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8742025-01-06T20:30:56.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 91e883ba-7558-4130-a771-3cbf36fbce04 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8752025-01-06T20:30:56.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 91e883ba-7558-4130-a771-3cbf36fbce04 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8762025-01-06T20:30:56.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1893 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 91e883ba-7558-4130-a771-3cbf36fbce04 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8772025-01-06T20:30:57.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 26d40ba5-3702-454e-be49-d3f65963c4d5 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8782025-01-06T20:30:57.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 26d40ba5-3702-454e-be49-d3f65963c4d5 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8792025-01-06T20:30:57.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2712 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 26d40ba5-3702-454e-be49-d3f65963c4d5 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8802025-01-06T20:30:57.764ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 579 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 8de12a9d-a8ea-4e8c-a97b-4153aca2b2ab response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
8812025-01-06T20:30:58.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c0893c40-60e6-457b-817c-ed00bb128437 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8822025-01-06T20:30:58.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c0893c40-60e6-457b-817c-ed00bb128437 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8832025-01-06T20:30:58.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c0893c40-60e6-457b-817c-ed00bb128437 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8842025-01-06T20:30:59.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f1a6ad34-9fee-4137-8d97-c3265ed0d1a4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8852025-01-06T20:30:59.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f1a6ad34-9fee-4137-8d97-c3265ed0d1a4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8862025-01-06T20:30:59.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f1a6ad34-9fee-4137-8d97-c3265ed0d1a4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8872025-01-06T20:31:00.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 20c3e84d-4c39-47e8-8f72-1a025ed2e11f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8882025-01-06T20:31:00.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 20c3e84d-4c39-47e8-8f72-1a025ed2e11f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8892025-01-06T20:31:00.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 20c3e84d-4c39-47e8-8f72-1a025ed2e11f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8902025-01-06T20:31:01.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 58cdfb67-0a5a-4d41-96c8-a79a1093dd71 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8912025-01-06T20:31:01.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 58cdfb67-0a5a-4d41-96c8-a79a1093dd71 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8922025-01-06T20:31:01.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 58cdfb67-0a5a-4d41-96c8-a79a1093dd71 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8932025-01-06T20:31:02.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9baf52b0-6619-4bbc-82fe-3ade79ebce02 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8942025-01-06T20:31:02.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9baf52b0-6619-4bbc-82fe-3ade79ebce02 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8952025-01-06T20:31:02.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9baf52b0-6619-4bbc-82fe-3ade79ebce02 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8962025-01-06T20:31:03.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8eb20b44-8fb9-4c73-98e8-eaf8352e9fa0 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8972025-01-06T20:31:03.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8eb20b44-8fb9-4c73-98e8-eaf8352e9fa0 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8982025-01-06T20:31:03.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8eb20b44-8fb9-4c73-98e8-eaf8352e9fa0 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
8992025-01-06T20:31:04.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 99118df7-b140-4c96-ada7-e58895f95cf6 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
9002025-01-06T20:31:04.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 99118df7-b140-4c96-ada7-e58895f95cf6 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
9012025-01-06T20:31:04.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 99118df7-b140-4c96-ada7-e58895f95cf6 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
9022025-01-06T20:31:04.989ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
9032025-01-06T20:31:04.990ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
9042025-01-06T20:31:04.990ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
9052025-01-06T20:31:04.990ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9062025-01-06T20:31:04.990ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
9072025-01-06T20:31:04.990ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9082025-01-06T20:31:04.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9092025-01-06T20:31:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9102025-01-06T20:31:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9112025-01-06T20:31:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9122025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
9132025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
9142025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
9152025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9162025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9172025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9182025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9192025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
9202025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
9212025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9222025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9232025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
9242025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9252025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
9262025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
9272025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
9282025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
9292025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
9302025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9312025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
9322025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
9332025-01-06T20:31:04.991ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9342025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9352025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
9362025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9372025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
9382025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9392025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9402025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9412025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9422025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9432025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
9442025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9452025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
9462025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9472025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9482025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9492025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9502025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9512025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9522025-01-06T20:31:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9532025-01-06T20:31:04.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9542025-01-06T20:31:04.992ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.049813ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9552025-01-06T20:31:04.993ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 907, tv_nsec: 680402365 } })
9562025-01-06T20:31:04.993ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 907, tv_nsec: 680563409 } })
9572025-01-06T20:31:04.993ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
9582025-01-06T20:31:04.993ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
9592025-01-06T20:31:04.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9602025-01-06T20:31:04.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9612025-01-06T20:31:04.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9622025-01-06T20:31:04.996ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9632025-01-06T20:31:04.997ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9642025-01-06T20:31:04.998ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9652025-01-06T20:31:04.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9662025-01-06T20:31:04.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
9672025-01-06T20:31:04.999ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9682025-01-06T20:31:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9692025-01-06T20:31:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
9702025-01-06T20:31:05.000ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9712025-01-06T20:31:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9722025-01-06T20:31:05.013ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9732025-01-06T20:31:05.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9742025-01-06T20:31:05.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9752025-01-06T20:31:05.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9762025-01-06T20:31:05.015ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 907, tv_nsec: 703060152 } })
9772025-01-06T20:31:05.016ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
9782025-01-06T20:31:05.041ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9792025-01-06T20:31:05.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9802025-01-06T20:31:05.043ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.52197ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
9812025-01-06T20:31:05.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9822025-01-06T20:31:05.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9832025-01-06T20:31:05.054ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9842025-01-06T20:31:05.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9852025-01-06T20:31:05.057ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9862025-01-06T20:31:05.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9872025-01-06T20:31:05.060ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9882025-01-06T20:31:05.060ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
9892025-01-06T20:31:05.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9902025-01-06T20:31:05.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9912025-01-06T20:31:05.061ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.982895ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
9922025-01-06T20:31:05.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9932025-01-06T20:31:05.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9942025-01-06T20:31:05.064ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9952025-01-06T20:31:05.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9962025-01-06T20:31:05.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9972025-01-06T20:31:05.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 74.974541ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
9982025-01-06T20:31:05.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
9992025-01-06T20:31:05.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10002025-01-06T20:31:05.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10012025-01-06T20:31:05.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10022025-01-06T20:31:05.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10032025-01-06T20:31:05.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10042025-01-06T20:31:05.069ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.440676ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10052025-01-06T20:31:05.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10062025-01-06T20:31:05.070ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10072025-01-06T20:31:05.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10082025-01-06T20:31:05.072ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10092025-01-06T20:31:05.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10102025-01-06T20:31:05.075ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10112025-01-06T20:31:05.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10122025-01-06T20:31:05.079ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10132025-01-06T20:31:05.079ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.321404ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10142025-01-06T20:31:05.079ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10152025-01-06T20:31:05.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10162025-01-06T20:31:05.082ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10172025-01-06T20:31:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10182025-01-06T20:31:05.084ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10192025-01-06T20:31:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10202025-01-06T20:31:05.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10212025-01-06T20:31:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10222025-01-06T20:31:05.088ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
10232025-01-06T20:31:05.088ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10242025-01-06T20:31:05.088ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6433976-2078-4b49-985e-e84953dd5f2c", "content-length": "26", "date": "Mon, 06 Jan 2025 20:31:05 GMT"} })
10252025-01-06T20:31:05.088ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10262025-01-06T20:31:05.090ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10272025-01-06T20:31:05.100ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
10282025-01-06T20:31:05.100ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 110.166559ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
10292025-01-06T20:31:05.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10302025-01-06T20:31:05.103ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
10312025-01-06T20:31:05.103ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10322025-01-06T20:31:05.103ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcc5d9ec-e48d-46be-a035-ccde2b96f602", "content-length": "26", "date": "Mon, 06 Jan 2025 20:31:05 GMT"} })
10332025-01-06T20:31:05.103ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10342025-01-06T20:31:05.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
10352025-01-06T20:31:05.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10362025-01-06T20:31:05.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10372025-01-06T20:31:05.105ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10382025-01-06T20:31:05.106ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
10392025-01-06T20:31:05.106ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10402025-01-06T20:31:05.106ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f933be3-d968-4182-9c68-1a7710d4153b", "content-length": "26", "date": "Mon, 06 Jan 2025 20:31:05 GMT"} })
10412025-01-06T20:31:05.106ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10422025-01-06T20:31:05.107ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10432025-01-06T20:31:05.107ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10442025-01-06T20:31:05.107ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10452025-01-06T20:31:05.107ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 116.82694ms iteration = 6 status = 0
10462025-01-06T20:31:05.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10472025-01-06T20:31:05.108ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
10482025-01-06T20:31:05.111ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.144411ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10492025-01-06T20:31:05.117ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10502025-01-06T20:31:05.120ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10512025-01-06T20:31:05.120ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10522025-01-06T20:31:05.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10532025-01-06T20:31:05.126ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 135.627112ms iteration = 8 status = {"physical_disks_added":0}
10542025-01-06T20:31:05.128ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 136.990959ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
10552025-01-06T20:31:05.147ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10562025-01-06T20:31:05.147ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
10572025-01-06T20:31:05.147ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 156.756257ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
10582025-01-06T20:31:05.148ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10592025-01-06T20:31:05.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10602025-01-06T20:31:05.177ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 187.638128ms iteration = 6 status = {}
10612025-01-06T20:31:05.179ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
10622025-01-06T20:31:05.179ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7bf23a6-4932-46e0-a57b-72323643fe63", "content-length": "1", "date": "Mon, 06 Jan 2025 20:31:04 GMT"} })
10632025-01-06T20:31:05.181ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10642025-01-06T20:31:05.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10652025-01-06T20:31:05.182ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 193.028304ms iteration = 6 status = null
10662025-01-06T20:31:05.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10672025-01-06T20:31:05.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10682025-01-06T20:31:05.187ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10692025-01-06T20:31:05.188ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10702025-01-06T20:31:05.188ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10712025-01-06T20:31:05.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10722025-01-06T20:31:05.190ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10732025-01-06T20:31:05.191ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10742025-01-06T20:31:05.191ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10752025-01-06T20:31:05.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10762025-01-06T20:31:05.262ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
10772025-01-06T20:31:05.262ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10782025-01-06T20:31:05.263ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce679408-d465-4709-a975-4c0a5eb348ce", "content-length": "372", "date": "Mon, 06 Jan 2025 20:31:05 GMT"} })
10792025-01-06T20:31:05.263ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10802025-01-06T20:31:05.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10812025-01-06T20:31:05.283ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
10822025-01-06T20:31:05.283ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
10832025-01-06T20:31:05.284ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "976c30b4-727b-4359-af05-080c0acab19f", "date": "Mon, 06 Jan 2025 20:31:05 GMT"} })
10842025-01-06T20:31:05.284ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10852025-01-06T20:31:05.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10862025-01-06T20:31:05.286ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10872025-01-06T20:31:05.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10882025-01-06T20:31:05.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10892025-01-06T20:31:05.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10902025-01-06T20:31:05.335ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10912025-01-06T20:31:05.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10922025-01-06T20:31:05.336ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
10932025-01-06T20:31:05.338ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
10942025-01-06T20:31:05.338ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10952025-01-06T20:31:05.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10962025-01-06T20:31:05.339ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
10972025-01-06T20:31:05.339ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10982025-01-06T20:31:05.348ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
10992025-01-06T20:31:05.348ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d256556f-6823-49a8-8834-14024a8a2675", "content-length": "134", "date": "Mon, 06 Jan 2025 20:31:04 GMT"} })
11002025-01-06T20:31:05.348ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
11012025-01-06T20:31:05.348ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
11022025-01-06T20:31:05.349ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
11032025-01-06T20:31:05.349ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11042025-01-06T20:31:05.349ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11052025-01-06T20:31:05.349ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11062025-01-06T20:31:05.349ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11072025-01-06T20:31:05.349ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11082025-01-06T20:31:05.349ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11092025-01-06T20:31:05.349ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11102025-01-06T20:31:05.349ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
11112025-01-06T20:31:05.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11122025-01-06T20:31:05.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11132025-01-06T20:31:05.352ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11142025-01-06T20:31:05.352ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "717160ad-7798-4b3f-a3dd-8aedac32a4ac", "content-length": "2", "date": "Mon, 06 Jan 2025 20:31:04 GMT"} })
11152025-01-06T20:31:05.352ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11162025-01-06T20:31:05.352ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ef31fb1-e6cd-40e1-a62d-6e73522f7560", "content-length": "52", "date": "Mon, 06 Jan 2025 20:31:04 GMT"} })
11172025-01-06T20:31:05.352ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
11182025-01-06T20:31:05.352ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11192025-01-06T20:31:05.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 26bed47e-de36-4334-9164-1e5ad356dd97 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11202025-01-06T20:31:05.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 26bed47e-de36-4334-9164-1e5ad356dd97 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11212025-01-06T20:31:05.400ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3db14469-df9d-4346-82b8-f1f69d35317b", "content-length": "691", "date": "Mon, 06 Jan 2025 20:31:05 GMT"} })
11222025-01-06T20:31:05.400ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
11232025-01-06T20:31:05.400ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
11242025-01-06T20:31:05.400ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
11252025-01-06T20:31:05.400ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bdd4d138-dce3-4976-9b39-e3cbd37ba3bb", "date": "Mon, 06 Jan 2025 20:31:05 GMT"} })
11262025-01-06T20:31:05.402ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 410.904265ms iteration = 6 status = {}
11272025-01-06T20:31:05.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 26bed47e-de36-4334-9164-1e5ad356dd97 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11282025-01-06T20:31:05.402ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 411.443189ms iteration = 6 status = {}
11292025-01-06T20:31:05.514ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "79f355ea-8585-4cb2-8a5b-a56e03383ebf", "date": "Mon, 06 Jan 2025 20:31:05 GMT"} })
11302025-01-06T20:31:05.514ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
11312025-01-06T20:31:05.514ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11322025-01-06T20:31:05.519ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e955836-3bca-42d6-bb6f-295becdb7924", "content-length": "682", "date": "Mon, 06 Jan 2025 20:31:05 GMT"} })
11332025-01-06T20:31:05.519ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11342025-01-06T20:31:05.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11352025-01-06T20:31:05.523ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11362025-01-06T20:31:05.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11372025-01-06T20:31:05.526ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11382025-01-06T20:31:05.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11392025-01-06T20:31:05.528ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11402025-01-06T20:31:05.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11412025-01-06T20:31:05.536ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 545.443088ms iteration = 6 status = {}
11422025-01-06T20:31:06.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e2381004-d87c-4509-8de3-b763f92edd04 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11432025-01-06T20:31:06.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e2381004-d87c-4509-8de3-b763f92edd04 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11442025-01-06T20:31:06.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e2381004-d87c-4509-8de3-b763f92edd04 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11452025-01-06T20:31:07.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dbe1bf8d-9f5f-493c-8e29-2e9a6ddca7f6 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11462025-01-06T20:31:07.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dbe1bf8d-9f5f-493c-8e29-2e9a6ddca7f6 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11472025-01-06T20:31:07.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dbe1bf8d-9f5f-493c-8e29-2e9a6ddca7f6 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11482025-01-06T20:31:07.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 688 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 8b803272-1cbf-437e-9250-ca687fc21854 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
11492025-01-06T20:31:08.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cc1f7c6c-3fca-4c97-8f98-90aad83a58bb roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11502025-01-06T20:31:08.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cc1f7c6c-3fca-4c97-8f98-90aad83a58bb resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11512025-01-06T20:31:08.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2711 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cc1f7c6c-3fca-4c97-8f98-90aad83a58bb response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11522025-01-06T20:31:09.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c91dbbf9-1686-433e-82db-5b9c1c87722e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11532025-01-06T20:31:09.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c91dbbf9-1686-433e-82db-5b9c1c87722e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11542025-01-06T20:31:09.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c91dbbf9-1686-433e-82db-5b9c1c87722e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11552025-01-06T20:31:10.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 61e9c6bc-e85f-48dd-ba3e-af1cf7ea81b2 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11562025-01-06T20:31:10.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 61e9c6bc-e85f-48dd-ba3e-af1cf7ea81b2 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11572025-01-06T20:31:10.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 61e9c6bc-e85f-48dd-ba3e-af1cf7ea81b2 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11582025-01-06T20:31:11.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fa591d99-e8bc-48f4-8fe9-6c9c39471797 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11592025-01-06T20:31:11.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fa591d99-e8bc-48f4-8fe9-6c9c39471797 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11602025-01-06T20:31:11.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fa591d99-e8bc-48f4-8fe9-6c9c39471797 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11612025-01-06T20:31:12.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e9534807-2207-4ea7-8fbd-215b955c0cf9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11622025-01-06T20:31:12.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e9534807-2207-4ea7-8fbd-215b955c0cf9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11632025-01-06T20:31:12.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e9534807-2207-4ea7-8fbd-215b955c0cf9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11642025-01-06T20:31:13.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 88b05e5b-bcb8-471d-8fa5-b2627b390d29 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11652025-01-06T20:31:13.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 88b05e5b-bcb8-471d-8fa5-b2627b390d29 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11662025-01-06T20:31:13.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 88b05e5b-bcb8-471d-8fa5-b2627b390d29 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11672025-01-06T20:31:14.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = da4724fd-05c9-4eef-9692-a761c02585a3 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11682025-01-06T20:31:14.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = da4724fd-05c9-4eef-9692-a761c02585a3 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11692025-01-06T20:31:14.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = da4724fd-05c9-4eef-9692-a761c02585a3 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11702025-01-06T20:31:14.989ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
11712025-01-06T20:31:14.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11722025-01-06T20:31:14.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11732025-01-06T20:31:14.990ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
11742025-01-06T20:31:14.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11752025-01-06T20:31:14.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11762025-01-06T20:31:14.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11772025-01-06T20:31:14.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11782025-01-06T20:31:14.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11792025-01-06T20:31:14.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11802025-01-06T20:31:14.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11812025-01-06T20:31:14.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11822025-01-06T20:31:14.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11832025-01-06T20:31:14.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
11842025-01-06T20:31:14.998ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11852025-01-06T20:31:14.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11862025-01-06T20:31:15.010ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
11872025-01-06T20:31:15.010ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.938369ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
11882025-01-06T20:31:15.019ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11892025-01-06T20:31:15.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11902025-01-06T20:31:15.050ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.205449ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11912025-01-06T20:31:15.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f6430961-1bd1-4d52-b3e2-b552bec9849d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11922025-01-06T20:31:15.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f6430961-1bd1-4d52-b3e2-b552bec9849d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11932025-01-06T20:31:15.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2741 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f6430961-1bd1-4d52-b3e2-b552bec9849d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11942025-01-06T20:31:16.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 099b47d1-4032-4b49-afb3-1e3e68a24d25 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11952025-01-06T20:31:16.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 099b47d1-4032-4b49-afb3-1e3e68a24d25 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11962025-01-06T20:31:16.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 099b47d1-4032-4b49-afb3-1e3e68a24d25 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11972025-01-06T20:31:17.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b24aca59-0a06-482a-a98a-e9357916cce9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11982025-01-06T20:31:17.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b24aca59-0a06-482a-a98a-e9357916cce9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
11992025-01-06T20:31:17.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b24aca59-0a06-482a-a98a-e9357916cce9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12002025-01-06T20:31:17.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 599a7df4-0f05-40f1-bdcb-ef8bebbf2c26 roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
12012025-01-06T20:31:17.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 599a7df4-0f05-40f1-bdcb-ef8bebbf2c26 resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
12022025-01-06T20:31:17.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 599a7df4-0f05-40f1-bdcb-ef8bebbf2c26 response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
12032025-01-06T20:31:17.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 6aa39e3c-c40c-48fc-b6d5-ee5efe225ebe roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
12042025-01-06T20:31:17.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 6aa39e3c-c40c-48fc-b6d5-ee5efe225ebe resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
12052025-01-06T20:31:17.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 6aa39e3c-c40c-48fc-b6d5-ee5efe225ebe response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
12062025-01-06T20:31:17.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 523 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 223e5316-2388-4938-bd86-950b9c987477 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
12072025-01-06T20:31:18.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bdcdf7b2-3ab7-48ba-8e7c-82de6f10aab6 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12082025-01-06T20:31:18.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bdcdf7b2-3ab7-48ba-8e7c-82de6f10aab6 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12092025-01-06T20:31:18.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bdcdf7b2-3ab7-48ba-8e7c-82de6f10aab6 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12102025-01-06T20:31:19.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7094084f-4319-426b-b225-da0fcfd3f72c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12112025-01-06T20:31:19.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7094084f-4319-426b-b225-da0fcfd3f72c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12122025-01-06T20:31:19.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7094084f-4319-426b-b225-da0fcfd3f72c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12132025-01-06T20:31:20.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 89471687-05b0-4bb3-8d2b-5843c0241b47 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12142025-01-06T20:31:20.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 89471687-05b0-4bb3-8d2b-5843c0241b47 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12152025-01-06T20:31:20.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 89471687-05b0-4bb3-8d2b-5843c0241b47 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12162025-01-06T20:31:21.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5b2e30d4-e27d-45d7-85b8-cb5cedcbec51 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12172025-01-06T20:31:21.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5b2e30d4-e27d-45d7-85b8-cb5cedcbec51 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12182025-01-06T20:31:21.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5b2e30d4-e27d-45d7-85b8-cb5cedcbec51 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12192025-01-06T20:31:22.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f25eee3b-86ff-4d3e-9bfd-ec2ab11b51c1 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12202025-01-06T20:31:22.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f25eee3b-86ff-4d3e-9bfd-ec2ab11b51c1 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12212025-01-06T20:31:22.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f25eee3b-86ff-4d3e-9bfd-ec2ab11b51c1 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12222025-01-06T20:31:23.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 03b19e42-58ed-46dc-b747-0fc3da80fe6b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12232025-01-06T20:31:23.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 03b19e42-58ed-46dc-b747-0fc3da80fe6b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12242025-01-06T20:31:23.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2685 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 03b19e42-58ed-46dc-b747-0fc3da80fe6b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12252025-01-06T20:31:24.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bd36d43c-900f-4183-97e1-4579a09dc51c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12262025-01-06T20:31:24.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bd36d43c-900f-4183-97e1-4579a09dc51c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12272025-01-06T20:31:24.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bd36d43c-900f-4183-97e1-4579a09dc51c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12282025-01-06T20:31:24.989ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
12292025-01-06T20:31:24.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12302025-01-06T20:31:24.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12312025-01-06T20:31:24.991ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
12322025-01-06T20:31:24.991ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12332025-01-06T20:31:24.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12342025-01-06T20:31:24.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12352025-01-06T20:31:24.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12362025-01-06T20:31:24.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12372025-01-06T20:31:24.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12382025-01-06T20:31:24.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12392025-01-06T20:31:24.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12402025-01-06T20:31:24.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12412025-01-06T20:31:24.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
12422025-01-06T20:31:24.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12432025-01-06T20:31:24.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12442025-01-06T20:31:25.011ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
12452025-01-06T20:31:25.011ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.116302ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
12462025-01-06T20:31:25.026ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12472025-01-06T20:31:25.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12482025-01-06T20:31:25.055ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.082264ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12492025-01-06T20:31:25.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 89825036-cb91-4c0f-8757-5e1dc0527397 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12502025-01-06T20:31:25.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 89825036-cb91-4c0f-8757-5e1dc0527397 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12512025-01-06T20:31:25.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 89825036-cb91-4c0f-8757-5e1dc0527397 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12522025-01-06T20:31:26.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 32668b38-1737-4659-b9a1-8ca8712f3666 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12532025-01-06T20:31:26.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 32668b38-1737-4659-b9a1-8ca8712f3666 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12542025-01-06T20:31:26.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 32668b38-1737-4659-b9a1-8ca8712f3666 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12552025-01-06T20:31:27.764ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 776 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 85b66eaa-0536-46e1-88dd-0690db441691 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
12562025-01-06T20:31:27.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 12ac287c-e0e7-4d7d-afef-308e978e7259 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12572025-01-06T20:31:27.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 12ac287c-e0e7-4d7d-afef-308e978e7259 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12582025-01-06T20:31:27.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 12ac287c-e0e7-4d7d-afef-308e978e7259 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12592025-01-06T20:31:28.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fa156437-e69a-4861-9ff5-ede8e566f26b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12602025-01-06T20:31:28.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fa156437-e69a-4861-9ff5-ede8e566f26b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12612025-01-06T20:31:28.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fa156437-e69a-4861-9ff5-ede8e566f26b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12622025-01-06T20:31:29.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f3e1ee06-93f6-4245-9951-fe918b208803 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12632025-01-06T20:31:29.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f3e1ee06-93f6-4245-9951-fe918b208803 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12642025-01-06T20:31:29.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f3e1ee06-93f6-4245-9951-fe918b208803 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12652025-01-06T20:31:30.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 69e67ddf-313d-4a37-93da-3c26427f2385 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12662025-01-06T20:31:30.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 69e67ddf-313d-4a37-93da-3c26427f2385 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12672025-01-06T20:31:30.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 69e67ddf-313d-4a37-93da-3c26427f2385 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12682025-01-06T20:31:31.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b7a8c674-b30c-4c35-b663-b1fb7c55f32a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12692025-01-06T20:31:31.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b7a8c674-b30c-4c35-b663-b1fb7c55f32a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12702025-01-06T20:31:31.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b7a8c674-b30c-4c35-b663-b1fb7c55f32a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12712025-01-06T20:31:32.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 3ede0211-da80-4d9e-a6a2-4905c002741b roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
12722025-01-06T20:31:32.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 3ede0211-da80-4d9e-a6a2-4905c002741b resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
12732025-01-06T20:31:32.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 3ede0211-da80-4d9e-a6a2-4905c002741b response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
12742025-01-06T20:31:32.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 03c88e7e-948e-4bb4-8cde-0c99d90d027e roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
12752025-01-06T20:31:32.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 03c88e7e-948e-4bb4-8cde-0c99d90d027e resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
12762025-01-06T20:31:32.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 03c88e7e-948e-4bb4-8cde-0c99d90d027e response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
12772025-01-06T20:31:32.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3256c3c7-3a8d-4c3c-886d-c7e591db04e8 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12782025-01-06T20:31:32.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3256c3c7-3a8d-4c3c-886d-c7e591db04e8 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12792025-01-06T20:31:32.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3256c3c7-3a8d-4c3c-886d-c7e591db04e8 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12802025-01-06T20:31:34.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = aec10393-e03f-42cd-956a-2deea6a483b5 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12812025-01-06T20:31:34.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = aec10393-e03f-42cd-956a-2deea6a483b5 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12822025-01-06T20:31:34.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = aec10393-e03f-42cd-956a-2deea6a483b5 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
12832025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
12842025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
12852025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
12862025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12872025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12882025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
12892025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
12902025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
12912025-01-06T20:31:34.990ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
12922025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
12932025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12942025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12952025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
12962025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12972025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
12982025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12992025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
13002025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13012025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13022025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
13032025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
13042025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
13052025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
13062025-01-06T20:31:34.990ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
13072025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13082025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13092025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
13102025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
13112025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
13122025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13132025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
13142025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
13152025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13162025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
13172025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13182025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
13192025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13202025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13212025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
13222025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
13232025-01-06T20:31:34.990ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-06 20:21:34.990475695 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13242025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
13252025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13262025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13272025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13282025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
13292025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13302025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
13312025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13322025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
13332025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
13342025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
13352025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
13362025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
13372025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13382025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
13392025-01-06T20:31:34.990ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468
13402025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.901\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468"}
13412025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
13422025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
13432025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
13442025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
13452025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
13462025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13472025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13482025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13492025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
13502025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13512025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13522025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13532025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13542025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13552025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
13562025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13572025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
13582025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13592025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13602025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13612025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13622025-01-06T20:31:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
13632025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13642025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13652025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13662025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13672025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13682025-01-06T20:31:34.991ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65bacdd1-9837-48ad-941c-aec5e2d79006.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 937, tv_nsec: 678497663 } })
13692025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13702025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
13712025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13722025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
13732025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
13742025-01-06T20:31:34.991ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("88aaaee6-38b4-4a83-9c08-04f0ea18e003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8dd67555-06fb-4cef-b914-9650f0eeb68a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 937, tv_nsec: 678649487 } })
13752025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13762025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13772025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
13782025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.212223ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
13792025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13802025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13812025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
13822025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.053819ms iteration = 4 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
13832025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13842025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13852025-01-06T20:31:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13862025-01-06T20:31:34.993ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13872025-01-06T20:31:34.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13882025-01-06T20:31:34.994ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.862916ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
13892025-01-06T20:31:34.996ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13902025-01-06T20:31:34.996ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13912025-01-06T20:31:34.998ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13922025-01-06T20:31:34.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
13932025-01-06T20:31:34.999ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13942025-01-06T20:31:35.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13952025-01-06T20:31:35.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
13962025-01-06T20:31:35.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13972025-01-06T20:31:35.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13982025-01-06T20:31:35.001ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13992025-01-06T20:31:35.001ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14002025-01-06T20:31:35.001ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14012025-01-06T20:31:35.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14022025-01-06T20:31:35.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14032025-01-06T20:31:35.004ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-06 20:21:34.990475695 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14042025-01-06T20:31:35.004ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.085123ms iteration = 4 status = {"expiration":"2025-01-06T20:21:34.990475695Z","pruned":[]}
14052025-01-06T20:31:35.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14062025-01-06T20:31:35.007ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14072025-01-06T20:31:35.008ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 937, tv_nsec: 695574738 } })
14082025-01-06T20:31:35.008ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
14092025-01-06T20:31:35.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14102025-01-06T20:31:35.010ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14112025-01-06T20:31:35.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14122025-01-06T20:31:35.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14132025-01-06T20:31:35.013ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14142025-01-06T20:31:35.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14152025-01-06T20:31:35.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14162025-01-06T20:31:35.019ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 937, tv_nsec: 707253136 } })
14172025-01-06T20:31:35.020ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
14182025-01-06T20:31:35.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14192025-01-06T20:31:35.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14202025-01-06T20:31:35.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14212025-01-06T20:31:35.023ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14222025-01-06T20:31:35.025ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 34.90061ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
14232025-01-06T20:31:35.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14242025-01-06T20:31:35.026ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14252025-01-06T20:31:35.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14262025-01-06T20:31:35.026ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14272025-01-06T20:31:35.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14282025-01-06T20:31:35.029ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14292025-01-06T20:31:35.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14302025-01-06T20:31:35.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8dff5fee-6d5b-4632-b3b6-c02995883782 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
14312025-01-06T20:31:35.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8dff5fee-6d5b-4632-b3b6-c02995883782 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
14322025-01-06T20:31:35.043ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14332025-01-06T20:31:35.043ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 53.539168ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14342025-01-06T20:31:35.044ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 937, tv_nsec: 731729472 } })
14352025-01-06T20:31:35.044ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
14362025-01-06T20:31:35.047ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14372025-01-06T20:31:35.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14382025-01-06T20:31:35.050ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14392025-01-06T20:31:35.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.966964ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
14402025-01-06T20:31:35.053ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14412025-01-06T20:31:35.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14422025-01-06T20:31:35.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14432025-01-06T20:31:35.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14442025-01-06T20:31:35.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14452025-01-06T20:31:35.063ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14462025-01-06T20:31:35.063ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14472025-01-06T20:31:35.063ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14482025-01-06T20:31:35.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14492025-01-06T20:31:35.064ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14502025-01-06T20:31:35.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14512025-01-06T20:31:35.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14522025-01-06T20:31:35.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14532025-01-06T20:31:35.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14542025-01-06T20:31:35.070ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 79.798403ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
14552025-01-06T20:31:35.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14562025-01-06T20:31:35.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14572025-01-06T20:31:35.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14582025-01-06T20:31:35.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14592025-01-06T20:31:35.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14602025-01-06T20:31:35.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38789 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8dff5fee-6d5b-4632-b3b6-c02995883782 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
14612025-01-06T20:31:35.073ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14622025-01-06T20:31:35.073ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14632025-01-06T20:31:35.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14642025-01-06T20:31:35.076ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14652025-01-06T20:31:35.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14662025-01-06T20:31:35.076ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14672025-01-06T20:31:35.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14682025-01-06T20:31:35.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
14692025-01-06T20:31:35.077ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14702025-01-06T20:31:35.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14712025-01-06T20:31:35.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14722025-01-06T20:31:35.078ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14732025-01-06T20:31:35.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14742025-01-06T20:31:35.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
14752025-01-06T20:31:35.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14762025-01-06T20:31:35.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14772025-01-06T20:31:35.082ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
14782025-01-06T20:31:35.082ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
14792025-01-06T20:31:35.082ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 92.266472ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
14802025-01-06T20:31:35.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14812025-01-06T20:31:35.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14822025-01-06T20:31:35.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14832025-01-06T20:31:35.084ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 94.76982ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14842025-01-06T20:31:35.087ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14852025-01-06T20:31:35.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14862025-01-06T20:31:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14872025-01-06T20:31:35.087ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14882025-01-06T20:31:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14892025-01-06T20:31:35.101ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14902025-01-06T20:31:35.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14912025-01-06T20:31:35.104ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14922025-01-06T20:31:35.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14932025-01-06T20:31:35.104ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14942025-01-06T20:31:35.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14952025-01-06T20:31:35.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14962025-01-06T20:31:35.107ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14972025-01-06T20:31:35.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14982025-01-06T20:31:35.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14992025-01-06T20:31:35.112ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15002025-01-06T20:31:35.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15012025-01-06T20:31:35.113ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15022025-01-06T20:31:35.113ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15032025-01-06T20:31:35.113ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15042025-01-06T20:31:35.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15052025-01-06T20:31:35.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15062025-01-06T20:31:35.115ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15072025-01-06T20:31:35.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15082025-01-06T20:31:35.119ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15092025-01-06T20:31:35.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15102025-01-06T20:31:35.127ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
15112025-01-06T20:31:35.127ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 136.614639ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
15122025-01-06T20:31:35.130ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
15132025-01-06T20:31:35.131ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 141.634576ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15142025-01-06T20:31:35.137ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15152025-01-06T20:31:35.137ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15162025-01-06T20:31:35.137ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15172025-01-06T20:31:35.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15182025-01-06T20:31:35.140ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15192025-01-06T20:31:35.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15202025-01-06T20:31:35.141ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15212025-01-06T20:31:35.146ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
15222025-01-06T20:31:35.146ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15232025-01-06T20:31:35.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15242025-01-06T20:31:35.148ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 158.133654ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15252025-01-06T20:31:35.149ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15262025-01-06T20:31:35.150ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
15272025-01-06T20:31:35.150ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
15282025-01-06T20:31:35.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15292025-01-06T20:31:35.150ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 160.050337ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15302025-01-06T20:31:35.152ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15312025-01-06T20:31:35.154ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15322025-01-06T20:31:35.154ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15332025-01-06T20:31:35.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15342025-01-06T20:31:35.162ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15352025-01-06T20:31:35.162ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15362025-01-06T20:31:35.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15372025-01-06T20:31:35.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15382025-01-06T20:31:35.165ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15392025-01-06T20:31:35.166ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
15402025-01-06T20:31:35.166ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
15412025-01-06T20:31:35.166ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
15422025-01-06T20:31:35.166ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15432025-01-06T20:31:35.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15442025-01-06T20:31:35.167ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15452025-01-06T20:31:35.167ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15462025-01-06T20:31:35.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15472025-01-06T20:31:35.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15482025-01-06T20:31:35.169ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15492025-01-06T20:31:35.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 181.311026ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
15502025-01-06T20:31:35.171ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
15512025-01-06T20:31:35.171ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 0 version = 2
15522025-01-06T20:31:35.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15532025-01-06T20:31:35.172ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15542025-01-06T20:31:35.172ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15552025-01-06T20:31:35.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15562025-01-06T20:31:35.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15572025-01-06T20:31:35.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15582025-01-06T20:31:35.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15592025-01-06T20:31:35.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15602025-01-06T20:31:35.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15612025-01-06T20:31:35.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15622025-01-06T20:31:35.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15632025-01-06T20:31:35.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15642025-01-06T20:31:35.181ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 1 version = 2
15652025-01-06T20:31:35.181ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
15662025-01-06T20:31:35.181ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-06 20:28:37.181288 UTC dns_group = external generation = 2
15672025-01-06T20:31:35.182ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 191.565304ms iteration = 4 status = {"generation":2}
15682025-01-06T20:31:35.188ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 197.726922ms iteration = 3 status = {"nsuccess":5}
15692025-01-06T20:31:35.188ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15702025-01-06T20:31:35.188ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15712025-01-06T20:31:35.188ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 198.649188ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15722025-01-06T20:31:35.205ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
15732025-01-06T20:31:35.205ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15742025-01-06T20:31:35.205ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88388d76-af27-481f-98b9-5d171a73b3b9", "content-length": "26", "date": "Mon, 06 Jan 2025 20:31:35 GMT"} })
15752025-01-06T20:31:35.205ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15762025-01-06T20:31:35.206ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
15772025-01-06T20:31:35.208ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-06T20:28:32.843602Z, time_modified: 2025-01-06T20:28:32.843602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }) }
15782025-01-06T20:31:35.208ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 217.959383ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]}},"default_endpoint":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
15792025-01-06T20:31:35.236ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15802025-01-06T20:31:35.236ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15812025-01-06T20:31:35.236ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f9e3d3e-f7c4-4e0d-9e48-4305200b3ac8", "content-length": "26", "date": "Mon, 06 Jan 2025 20:31:35 GMT"} })
15822025-01-06T20:31:35.236ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15832025-01-06T20:31:35.238ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15842025-01-06T20:31:35.241ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
15852025-01-06T20:31:35.245ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
15862025-01-06T20:31:35.245ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
15872025-01-06T20:31:35.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15882025-01-06T20:31:35.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15892025-01-06T20:31:35.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15902025-01-06T20:31:35.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15912025-01-06T20:31:35.252ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15922025-01-06T20:31:35.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15932025-01-06T20:31:35.252ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 262.344751ms iteration = 9 status = {"physical_disks_added":0}
15942025-01-06T20:31:35.255ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
15952025-01-06T20:31:35.255ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
15962025-01-06T20:31:35.255ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-06 20:28:35.848690 UTC dns_group = internal generation = 1
15972025-01-06T20:31:35.255ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 265.167288ms iteration = 4 status = {"generation":1}
15982025-01-06T20:31:35.315ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
15992025-01-06T20:31:35.315ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 324.864714ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
16002025-01-06T20:31:35.329ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16012025-01-06T20:31:35.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16022025-01-06T20:31:35.331ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16032025-01-06T20:31:35.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16042025-01-06T20:31:35.333ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16052025-01-06T20:31:35.337ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
16062025-01-06T20:31:35.337ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16072025-01-06T20:31:35.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16082025-01-06T20:31:35.357ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
16092025-01-06T20:31:35.357ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1589aaaf-dc94-4b1d-a98b-d0414bab7762", "date": "Mon, 06 Jan 2025 20:31:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16102025-01-06T20:31:35.357ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16112025-01-06T20:31:35.359ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b195914e-bebe-4d6f-96b0-6c0b7fb07f26", "date": "Mon, 06 Jan 2025 20:31:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16122025-01-06T20:31:35.359ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16132025-01-06T20:31:35.360ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16142025-01-06T20:31:35.360ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16152025-01-06T20:31:35.360ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f46d1cf-1aca-499a-8e18-d8da0e0c653f", "content-length": "26", "date": "Mon, 06 Jan 2025 20:31:35 GMT"} })
16162025-01-06T20:31:35.360ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16172025-01-06T20:31:35.361ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16182025-01-06T20:31:35.361ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 371.627246ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16192025-01-06T20:31:35.362ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16202025-01-06T20:31:35.399ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16212025-01-06T20:31:35.400ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "58d71c4a-eee5-41a0-b33b-9b97310f76d1", "content-length": "691", "date": "Mon, 06 Jan 2025 20:31:35 GMT"} })
16222025-01-06T20:31:35.400ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
16232025-01-06T20:31:35.400ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
16242025-01-06T20:31:35.400ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
16252025-01-06T20:31:35.401ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16262025-01-06T20:31:35.401ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16272025-01-06T20:31:35.402ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7342cd63-5175-4cd8-bd35-7da72235c775", "content-length": "372", "date": "Mon, 06 Jan 2025 20:31:35 GMT"} })
16282025-01-06T20:31:35.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16292025-01-06T20:31:35.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16302025-01-06T20:31:35.402ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 412.151499ms iteration = 7 status = 0
16312025-01-06T20:31:35.403ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 413.098214ms iteration = 7 status = {}
16322025-01-06T20:31:35.415ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 424.897956ms iteration = 7 status = {}
16332025-01-06T20:31:35.439ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16342025-01-06T20:31:35.446ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
16352025-01-06T20:31:35.446ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16362025-01-06T20:31:35.447ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7fe023a2-80ae-4868-8e61-ae5679e66d18", "date": "Mon, 06 Jan 2025 20:31:35 GMT"} })
16372025-01-06T20:31:35.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16382025-01-06T20:31:35.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16392025-01-06T20:31:35.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16402025-01-06T20:31:35.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16412025-01-06T20:31:35.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16422025-01-06T20:31:35.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16432025-01-06T20:31:35.459ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16442025-01-06T20:31:35.459ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16452025-01-06T20:31:35.459ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ae290a50-f115-47bc-9ee9-3a084109771e", "date": "Mon, 06 Jan 2025 20:31:35 GMT"} })
16462025-01-06T20:31:35.461ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 471.325609ms iteration = 7 status = {}
16472025-01-06T20:31:35.466ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16482025-01-06T20:31:35.467ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ce68ca6-ffba-4ccb-ac29-ae47831ff96c", "content-length": "1", "date": "Mon, 06 Jan 2025 20:31:34 GMT"} })
16492025-01-06T20:31:35.468ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16502025-01-06T20:31:35.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16512025-01-06T20:31:35.470ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 479.782849ms iteration = 7 status = null
16522025-01-06T20:31:35.511ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
16532025-01-06T20:31:35.511ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "cf973407-c684-4a69-a55f-466ceb9a0d32", "date": "Mon, 06 Jan 2025 20:31:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16542025-01-06T20:31:35.511ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16552025-01-06T20:31:35.512ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d7785246-b21d-4877-97c8-e7d6d0816156", "date": "Mon, 06 Jan 2025 20:31:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16562025-01-06T20:31:35.512ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16572025-01-06T20:31:35.514ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9fde1bdc-800f-4d5a-86b1-99c05ea39609", "date": "Mon, 06 Jan 2025 20:31:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16582025-01-06T20:31:35.514ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16592025-01-06T20:31:35.516ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16602025-01-06T20:31:35.516ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 526.191393ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16612025-01-06T20:31:35.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16622025-01-06T20:31:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16632025-01-06T20:31:35.531ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
16642025-01-06T20:31:35.531ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16652025-01-06T20:31:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16662025-01-06T20:31:35.541ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16672025-01-06T20:31:35.541ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e55e4dc-cb01-4441-80b0-eefc5ea96aad", "content-length": "134", "date": "Mon, 06 Jan 2025 20:31:34 GMT"} })
16682025-01-06T20:31:35.541ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
16692025-01-06T20:31:35.541ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
16702025-01-06T20:31:35.541ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16712025-01-06T20:31:35.541ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16722025-01-06T20:31:35.541ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16732025-01-06T20:31:35.541ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16742025-01-06T20:31:35.541ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16752025-01-06T20:31:35.542ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16762025-01-06T20:31:35.542ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16772025-01-06T20:31:35.542ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16782025-01-06T20:31:35.542ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
16792025-01-06T20:31:35.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16802025-01-06T20:31:35.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16812025-01-06T20:31:35.544ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16822025-01-06T20:31:35.545ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e082a4f9-f9ec-4782-a121-25f2ffb9ab4b", "content-length": "2", "date": "Mon, 06 Jan 2025 20:31:34 GMT"} })
16832025-01-06T20:31:35.545ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16842025-01-06T20:31:35.545ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea749299-757e-44e0-aaa0-b457c9ed931b", "content-length": "52", "date": "Mon, 06 Jan 2025 20:31:34 GMT"} })
16852025-01-06T20:31:35.545ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
16862025-01-06T20:31:35.545ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16872025-01-06T20:31:35.650ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2ffcaef3-c021-4b12-8762-794fd38f57bb", "date": "Mon, 06 Jan 2025 20:31:35 GMT"} })
16882025-01-06T20:31:35.650ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
16892025-01-06T20:31:35.650ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16902025-01-06T20:31:35.651ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "408b6e63-a71b-4552-9d77-995994a374b6", "content-length": "682", "date": "Mon, 06 Jan 2025 20:31:35 GMT"} })
16912025-01-06T20:31:35.651ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16922025-01-06T20:31:35.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16932025-01-06T20:31:35.655ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16942025-01-06T20:31:35.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16952025-01-06T20:31:35.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16962025-01-06T20:31:35.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16972025-01-06T20:31:35.662ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16982025-01-06T20:31:35.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16992025-01-06T20:31:35.669ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 679.552828ms iteration = 7 status = {}
17002025-01-06T20:31:36.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 38cf383f-5a45-484f-87cc-3a6fc8394d0f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17012025-01-06T20:31:36.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 38cf383f-5a45-484f-87cc-3a6fc8394d0f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17022025-01-06T20:31:36.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 38cf383f-5a45-484f-87cc-3a6fc8394d0f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17032025-01-06T20:31:37.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 23a89c92-cf72-464f-a486-3e31c9678244 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17042025-01-06T20:31:37.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 23a89c92-cf72-464f-a486-3e31c9678244 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17052025-01-06T20:31:37.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 23a89c92-cf72-464f-a486-3e31c9678244 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17062025-01-06T20:31:37.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 578 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 1f809de2-2f8f-4fba-acb9-964976f7c5c8 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
17072025-01-06T20:31:38.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 02e64edd-abda-4b2a-964b-f65bf5856f49 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17082025-01-06T20:31:38.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 02e64edd-abda-4b2a-964b-f65bf5856f49 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17092025-01-06T20:31:38.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 02e64edd-abda-4b2a-964b-f65bf5856f49 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17102025-01-06T20:31:39.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 36574b72-c7da-4672-bb9b-69712a52b0de roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17112025-01-06T20:31:39.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 36574b72-c7da-4672-bb9b-69712a52b0de resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17122025-01-06T20:31:39.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 36574b72-c7da-4672-bb9b-69712a52b0de response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17132025-01-06T20:31:40.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5dd08b1f-48a5-42ad-b79b-9ef28305a554 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17142025-01-06T20:31:40.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5dd08b1f-48a5-42ad-b79b-9ef28305a554 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17152025-01-06T20:31:40.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5dd08b1f-48a5-42ad-b79b-9ef28305a554 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17162025-01-06T20:31:41.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ae323f4d-3f13-40aa-ba2c-adafb57dbb31 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17172025-01-06T20:31:41.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ae323f4d-3f13-40aa-ba2c-adafb57dbb31 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17182025-01-06T20:31:41.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4795 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ae323f4d-3f13-40aa-ba2c-adafb57dbb31 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17192025-01-06T20:31:42.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7af49a86-fd09-4792-a81c-25419130fe08 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17202025-01-06T20:31:42.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7af49a86-fd09-4792-a81c-25419130fe08 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17212025-01-06T20:31:42.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7af49a86-fd09-4792-a81c-25419130fe08 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17222025-01-06T20:31:43.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e09e42e8-ed11-4a10-9c43-2a0a352205f3 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17232025-01-06T20:31:43.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e09e42e8-ed11-4a10-9c43-2a0a352205f3 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17242025-01-06T20:31:43.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e09e42e8-ed11-4a10-9c43-2a0a352205f3 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17252025-01-06T20:31:44.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7128b071-7a47-4693-94f9-377771a183a3 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17262025-01-06T20:31:44.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7128b071-7a47-4693-94f9-377771a183a3 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17272025-01-06T20:31:44.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7128b071-7a47-4693-94f9-377771a183a3 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17282025-01-06T20:31:44.989ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
17292025-01-06T20:31:44.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17302025-01-06T20:31:44.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17312025-01-06T20:31:44.990ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
17322025-01-06T20:31:44.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17332025-01-06T20:31:44.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17342025-01-06T20:31:44.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17352025-01-06T20:31:44.992ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17362025-01-06T20:31:44.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17372025-01-06T20:31:44.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17382025-01-06T20:31:44.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17392025-01-06T20:31:44.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17402025-01-06T20:31:44.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17412025-01-06T20:31:44.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17422025-01-06T20:31:44.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17432025-01-06T20:31:44.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
17442025-01-06T20:31:44.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17452025-01-06T20:31:44.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17462025-01-06T20:31:45.008ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
17472025-01-06T20:31:45.008ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.414281ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
17482025-01-06T20:31:45.020ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.664675ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17492025-01-06T20:31:45.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7bcddbd1-93fb-41fe-90b5-d07d701d9315 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17502025-01-06T20:31:45.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7bcddbd1-93fb-41fe-90b5-d07d701d9315 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17512025-01-06T20:31:45.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7bcddbd1-93fb-41fe-90b5-d07d701d9315 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17522025-01-06T20:31:46.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8d65ac8f-4d30-4626-b0cd-a81310d468b4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17532025-01-06T20:31:46.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8d65ac8f-4d30-4626-b0cd-a81310d468b4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17542025-01-06T20:31:46.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8d65ac8f-4d30-4626-b0cd-a81310d468b4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17552025-01-06T20:31:47.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6b7a8a43-829a-4d84-b4c1-f4d9e8062c35 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17562025-01-06T20:31:47.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6b7a8a43-829a-4d84-b4c1-f4d9e8062c35 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17572025-01-06T20:31:47.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1703 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6b7a8a43-829a-4d84-b4c1-f4d9e8062c35 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17582025-01-06T20:31:47.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 519 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 51147db6-33a1-49e0-ad96-590474a4357d response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
17592025-01-06T20:31:48.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 507d7019-aba6-4702-87cc-79d8128a87b9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17602025-01-06T20:31:48.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 507d7019-aba6-4702-87cc-79d8128a87b9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17612025-01-06T20:31:48.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 507d7019-aba6-4702-87cc-79d8128a87b9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17622025-01-06T20:31:49.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = deb03808-0b2a-4125-89f8-9885154a626a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17632025-01-06T20:31:49.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = deb03808-0b2a-4125-89f8-9885154a626a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17642025-01-06T20:31:49.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2576 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = deb03808-0b2a-4125-89f8-9885154a626a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17652025-01-06T20:31:50.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ca5d0f09-fe20-4b26-8543-b0fb06d440b3 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17662025-01-06T20:31:50.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ca5d0f09-fe20-4b26-8543-b0fb06d440b3 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17672025-01-06T20:31:50.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ca5d0f09-fe20-4b26-8543-b0fb06d440b3 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17682025-01-06T20:31:51.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 73ffb7f4-d2b5-4504-b486-1fd5359e5fa4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17692025-01-06T20:31:51.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 73ffb7f4-d2b5-4504-b486-1fd5359e5fa4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17702025-01-06T20:31:51.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 73ffb7f4-d2b5-4504-b486-1fd5359e5fa4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17712025-01-06T20:31:52.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7625035a-4741-4ac2-9ef5-c3d81c0c8d63 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17722025-01-06T20:31:52.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7625035a-4741-4ac2-9ef5-c3d81c0c8d63 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17732025-01-06T20:31:52.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7625035a-4741-4ac2-9ef5-c3d81c0c8d63 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17742025-01-06T20:31:53.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b87e2315-6829-4213-8887-501a15068d3d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17752025-01-06T20:31:53.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b87e2315-6829-4213-8887-501a15068d3d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17762025-01-06T20:31:53.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b87e2315-6829-4213-8887-501a15068d3d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17772025-01-06T20:31:54.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 596ab463-71cd-45d0-b5a9-024f7bb8f17c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17782025-01-06T20:31:54.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 596ab463-71cd-45d0-b5a9-024f7bb8f17c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17792025-01-06T20:31:54.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 596ab463-71cd-45d0-b5a9-024f7bb8f17c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
17802025-01-06T20:31:54.989ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
17812025-01-06T20:31:54.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17822025-01-06T20:31:54.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17832025-01-06T20:31:54.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
17842025-01-06T20:31:54.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17852025-01-06T20:31:54.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17862025-01-06T20:31:54.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17872025-01-06T20:31:54.992ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17882025-01-06T20:31:54.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17892025-01-06T20:31:54.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17902025-01-06T20:31:54.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17912025-01-06T20:31:54.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17922025-01-06T20:31:54.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17932025-01-06T20:31:54.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17942025-01-06T20:31:54.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17952025-01-06T20:31:54.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
17962025-01-06T20:31:54.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17972025-01-06T20:31:54.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17982025-01-06T20:31:55.010ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
17992025-01-06T20:31:55.010ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.816024ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
18002025-01-06T20:31:55.020ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.48757ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18012025-01-06T20:31:55.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d1682b23-2038-43ce-860a-cabd72cc0e12 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18022025-01-06T20:31:55.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d1682b23-2038-43ce-860a-cabd72cc0e12 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18032025-01-06T20:31:55.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d1682b23-2038-43ce-860a-cabd72cc0e12 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18042025-01-06T20:31:56.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b02ed63b-bc6a-4d97-afd0-2847f0d69a2f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18052025-01-06T20:31:56.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b02ed63b-bc6a-4d97-afd0-2847f0d69a2f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18062025-01-06T20:31:56.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b02ed63b-bc6a-4d97-afd0-2847f0d69a2f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18072025-01-06T20:31:57.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5abf3e14-216c-4d61-8547-a08c3005e648 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18082025-01-06T20:31:57.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5abf3e14-216c-4d61-8547-a08c3005e648 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18092025-01-06T20:31:57.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5abf3e14-216c-4d61-8547-a08c3005e648 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18102025-01-06T20:31:57.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 528 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = a06e69cf-58be-45f1-9e0a-52346a42b4dc response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
18112025-01-06T20:31:58.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 542f1b5a-fedb-4055-b808-3b495308cf57 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18122025-01-06T20:31:58.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 542f1b5a-fedb-4055-b808-3b495308cf57 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18132025-01-06T20:31:58.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 542f1b5a-fedb-4055-b808-3b495308cf57 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18142025-01-06T20:31:59.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0b89efe8-0822-4252-8717-5d99df34d0b5 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18152025-01-06T20:31:59.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0b89efe8-0822-4252-8717-5d99df34d0b5 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18162025-01-06T20:31:59.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0b89efe8-0822-4252-8717-5d99df34d0b5 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18172025-01-06T20:32:00.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 95e71b23-7a0b-4db9-b2c6-3f0696101a9a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18182025-01-06T20:32:00.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 95e71b23-7a0b-4db9-b2c6-3f0696101a9a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18192025-01-06T20:32:00.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 95e71b23-7a0b-4db9-b2c6-3f0696101a9a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18202025-01-06T20:32:01.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 75df7a48-2fe0-46e0-8ccd-9f94f8a023d3 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18212025-01-06T20:32:01.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 75df7a48-2fe0-46e0-8ccd-9f94f8a023d3 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18222025-01-06T20:32:01.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 75df7a48-2fe0-46e0-8ccd-9f94f8a023d3 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18232025-01-06T20:32:02.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d244de81-ba36-420e-8b82-2c30ea59f5d6 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18242025-01-06T20:32:02.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d244de81-ba36-420e-8b82-2c30ea59f5d6 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18252025-01-06T20:32:02.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d244de81-ba36-420e-8b82-2c30ea59f5d6 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18262025-01-06T20:32:02.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 5d6d9698-b2c6-45a9-9aee-f7d4eacb4614 roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
18272025-01-06T20:32:02.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 5d6d9698-b2c6-45a9-9aee-f7d4eacb4614 resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
18282025-01-06T20:32:02.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 5d6d9698-b2c6-45a9-9aee-f7d4eacb4614 response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
18292025-01-06T20:32:02.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 9cd8725d-6444-4c65-a2a4-5966daf8b4ad roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
18302025-01-06T20:32:02.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 9cd8725d-6444-4c65-a2a4-5966daf8b4ad resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
18312025-01-06T20:32:02.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2785 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 9cd8725d-6444-4c65-a2a4-5966daf8b4ad response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
18322025-01-06T20:32:03.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0efca075-fb3b-42f4-8689-e83269eaa3cf roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18332025-01-06T20:32:03.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0efca075-fb3b-42f4-8689-e83269eaa3cf resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18342025-01-06T20:32:03.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3630 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0efca075-fb3b-42f4-8689-e83269eaa3cf response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18352025-01-06T20:32:04.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3aafc063-b0a9-47ec-b80d-0a90f86f8b5d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18362025-01-06T20:32:04.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3aafc063-b0a9-47ec-b80d-0a90f86f8b5d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18372025-01-06T20:32:04.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1759 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3aafc063-b0a9-47ec-b80d-0a90f86f8b5d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
18382025-01-06T20:32:04.988ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
18392025-01-06T20:32:04.989ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
18402025-01-06T20:32:04.989ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18412025-01-06T20:32:04.989ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
18422025-01-06T20:32:04.989ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
18432025-01-06T20:32:04.989ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18442025-01-06T20:32:04.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18452025-01-06T20:32:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18462025-01-06T20:32:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18472025-01-06T20:32:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18482025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
18492025-01-06T20:32:04.990ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18502025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
18512025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
18522025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18532025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18542025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18552025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
18562025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18572025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18582025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
18592025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18602025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
18612025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18622025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
18632025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18642025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
18652025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18662025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
18672025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
18682025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
18692025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18702025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18712025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18722025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
18732025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
18742025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
18752025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18762025-01-06T20:32:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18772025-01-06T20:32:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18782025-01-06T20:32:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18792025-01-06T20:32:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18802025-01-06T20:32:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18812025-01-06T20:32:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18822025-01-06T20:32:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18832025-01-06T20:32:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18842025-01-06T20:32:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18852025-01-06T20:32:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18862025-01-06T20:32:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18872025-01-06T20:32:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18882025-01-06T20:32:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
18892025-01-06T20:32:04.991ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 967, tv_nsec: 679524311 } })
18902025-01-06T20:32:04.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18912025-01-06T20:32:04.992ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18922025-01-06T20:32:04.992ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 967, tv_nsec: 679773147 } })
18932025-01-06T20:32:04.992ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
18942025-01-06T20:32:04.992ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
18952025-01-06T20:32:04.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18962025-01-06T20:32:04.993ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18972025-01-06T20:32:04.994ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.471779ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18982025-01-06T20:32:04.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18992025-01-06T20:32:04.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19002025-01-06T20:32:04.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19012025-01-06T20:32:04.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19022025-01-06T20:32:04.996ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19032025-01-06T20:32:04.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19042025-01-06T20:32:04.998ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19052025-01-06T20:32:04.999ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19062025-01-06T20:32:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19072025-01-06T20:32:05.000ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19082025-01-06T20:32:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19092025-01-06T20:32:05.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19102025-01-06T20:32:05.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19112025-01-06T20:32:05.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19122025-01-06T20:32:05.003ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19132025-01-06T20:32:05.004ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.383342ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19142025-01-06T20:32:05.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19152025-01-06T20:32:05.005ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19162025-01-06T20:32:05.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19172025-01-06T20:32:05.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19182025-01-06T20:32:05.006ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19192025-01-06T20:32:05.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19202025-01-06T20:32:05.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19212025-01-06T20:32:05.008ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19222025-01-06T20:32:05.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19232025-01-06T20:32:05.009ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19242025-01-06T20:32:05.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19252025-01-06T20:32:05.010ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 967, tv_nsec: 698134837 } })
19262025-01-06T20:32:05.010ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
19272025-01-06T20:32:05.011ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19282025-01-06T20:32:05.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19292025-01-06T20:32:05.014ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19302025-01-06T20:32:05.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19312025-01-06T20:32:05.044ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19322025-01-06T20:32:05.044ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19332025-01-06T20:32:05.044ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19342025-01-06T20:32:05.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19352025-01-06T20:32:05.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19362025-01-06T20:32:05.047ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19372025-01-06T20:32:05.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19382025-01-06T20:32:05.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19392025-01-06T20:32:05.048ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19402025-01-06T20:32:05.048ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19412025-01-06T20:32:05.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19422025-01-06T20:32:05.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19432025-01-06T20:32:05.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19442025-01-06T20:32:05.051ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19452025-01-06T20:32:05.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19462025-01-06T20:32:05.052ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.07647ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
19472025-01-06T20:32:05.053ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19482025-01-06T20:32:05.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19492025-01-06T20:32:05.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19502025-01-06T20:32:05.059ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19512025-01-06T20:32:05.060ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.358218ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19522025-01-06T20:32:05.062ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 71.519027ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
19532025-01-06T20:32:05.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19542025-01-06T20:32:05.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19552025-01-06T20:32:05.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19562025-01-06T20:32:05.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
19572025-01-06T20:32:05.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19582025-01-06T20:32:05.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19592025-01-06T20:32:05.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19602025-01-06T20:32:05.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19612025-01-06T20:32:05.070ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19622025-01-06T20:32:05.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19632025-01-06T20:32:05.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 80.939824ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19642025-01-06T20:32:05.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.330194ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19652025-01-06T20:32:05.072ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19662025-01-06T20:32:05.072ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19672025-01-06T20:32:05.073ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b79fe7b-24ba-4a70-a2b7-0e5a45c9cbf5", "content-length": "26", "date": "Mon, 06 Jan 2025 20:32:05 GMT"} })
19682025-01-06T20:32:05.073ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19692025-01-06T20:32:05.075ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19702025-01-06T20:32:05.081ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19712025-01-06T20:32:05.081ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19722025-01-06T20:32:05.082ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "48a8e7f5-8491-405f-9900-055b5de0189f", "content-length": "26", "date": "Mon, 06 Jan 2025 20:32:05 GMT"} })
19732025-01-06T20:32:05.082ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19742025-01-06T20:32:05.083ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19752025-01-06T20:32:05.090ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19762025-01-06T20:32:05.090ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19772025-01-06T20:32:05.090ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 99.967741ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19782025-01-06T20:32:05.090ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
19792025-01-06T20:32:05.090ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 101.708629ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
19802025-01-06T20:32:05.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19812025-01-06T20:32:05.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19822025-01-06T20:32:05.110ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
19832025-01-06T20:32:05.110ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19842025-01-06T20:32:05.110ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a326ed1-9209-413a-a454-8e5eadfc63ea", "content-length": "26", "date": "Mon, 06 Jan 2025 20:32:05 GMT"} })
19852025-01-06T20:32:05.110ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19862025-01-06T20:32:05.113ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
19872025-01-06T20:32:05.124ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19882025-01-06T20:32:05.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
19892025-01-06T20:32:05.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19902025-01-06T20:32:05.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19912025-01-06T20:32:05.129ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 139.200689ms iteration = 8 status = 0
19922025-01-06T20:32:05.145ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 154.607069ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
19932025-01-06T20:32:05.154ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19942025-01-06T20:32:05.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19952025-01-06T20:32:05.158ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.386086ms iteration = 10 status = {"physical_disks_added":0}
19962025-01-06T20:32:05.187ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19972025-01-06T20:32:05.187ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ada3fbfa-e461-4db7-9e1e-4d3abcd15699", "content-length": "1", "date": "Mon, 06 Jan 2025 20:32:04 GMT"} })
19982025-01-06T20:32:05.189ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19992025-01-06T20:32:05.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20002025-01-06T20:32:05.254ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 265.195899ms iteration = 8 status = {}
20012025-01-06T20:32:05.257ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20022025-01-06T20:32:05.257ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20032025-01-06T20:32:05.257ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "17f2b3f5-941e-481b-ae61-7f98fec5e0a6", "content-length": "372", "date": "Mon, 06 Jan 2025 20:32:05 GMT"} })
20042025-01-06T20:32:05.257ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20052025-01-06T20:32:05.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20062025-01-06T20:32:05.259ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 270.420201ms iteration = 8 status = null
20072025-01-06T20:32:05.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20082025-01-06T20:32:05.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20092025-01-06T20:32:05.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20102025-01-06T20:32:05.284ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20112025-01-06T20:32:05.284ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20122025-01-06T20:32:05.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20132025-01-06T20:32:05.287ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20142025-01-06T20:32:05.289ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20152025-01-06T20:32:05.289ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20162025-01-06T20:32:05.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20172025-01-06T20:32:05.336ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
20182025-01-06T20:32:05.336ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20192025-01-06T20:32:05.336ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3d6c5ae9-c0c9-4516-8501-664628f03e48", "date": "Mon, 06 Jan 2025 20:32:05 GMT"} })
20202025-01-06T20:32:05.336ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20212025-01-06T20:32:05.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20222025-01-06T20:32:05.338ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20232025-01-06T20:32:05.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20242025-01-06T20:32:05.342ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20252025-01-06T20:32:05.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20262025-01-06T20:32:05.346ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20272025-01-06T20:32:05.346ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20282025-01-06T20:32:05.346ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "46d27e5f-55c9-4eb6-8f94-67769680cc21", "date": "Mon, 06 Jan 2025 20:32:05 GMT"} })
20292025-01-06T20:32:05.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20302025-01-06T20:32:05.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20312025-01-06T20:32:05.348ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 358.251422ms iteration = 8 status = {}
20322025-01-06T20:32:05.349ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
20332025-01-06T20:32:05.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20342025-01-06T20:32:05.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20352025-01-06T20:32:05.370ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20362025-01-06T20:32:05.371ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d08ce2a-3fc9-498a-828a-e12dee4f4769", "content-length": "134", "date": "Mon, 06 Jan 2025 20:32:04 GMT"} })
20372025-01-06T20:32:05.371ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
20382025-01-06T20:32:05.371ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
20392025-01-06T20:32:05.371ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20402025-01-06T20:32:05.371ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20412025-01-06T20:32:05.371ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20422025-01-06T20:32:05.371ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20432025-01-06T20:32:05.371ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20442025-01-06T20:32:05.371ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20452025-01-06T20:32:05.371ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20462025-01-06T20:32:05.371ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20472025-01-06T20:32:05.371ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
20482025-01-06T20:32:05.371ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20492025-01-06T20:32:05.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20502025-01-06T20:32:05.374ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20512025-01-06T20:32:05.374ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb75e23c-0a60-483e-856d-7d59c449a876", "content-length": "2", "date": "Mon, 06 Jan 2025 20:32:04 GMT"} })
20522025-01-06T20:32:05.374ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20532025-01-06T20:32:05.374ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c00dc12d-d995-422e-9daa-f1f700c56c5f", "content-length": "52", "date": "Mon, 06 Jan 2025 20:32:04 GMT"} })
20542025-01-06T20:32:05.374ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
20552025-01-06T20:32:05.374ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20562025-01-06T20:32:05.395ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20572025-01-06T20:32:05.397ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "02121105-dc6e-4578-b80c-aba9e825ac72", "content-length": "691", "date": "Mon, 06 Jan 2025 20:32:05 GMT"} })
20582025-01-06T20:32:05.397ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
20592025-01-06T20:32:05.397ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
20602025-01-06T20:32:05.397ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
20612025-01-06T20:32:05.397ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 407.268266ms iteration = 8 status = {}
20622025-01-06T20:32:05.473ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "da253714-e636-47ea-9ea5-5707a31875c0", "date": "Mon, 06 Jan 2025 20:32:05 GMT"} })
20632025-01-06T20:32:05.473ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
20642025-01-06T20:32:05.473ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20652025-01-06T20:32:05.477ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4135a7df-a6df-4d87-8140-54bef550d053", "content-length": "682", "date": "Mon, 06 Jan 2025 20:32:05 GMT"} })
20662025-01-06T20:32:05.477ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20672025-01-06T20:32:05.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20682025-01-06T20:32:05.481ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20692025-01-06T20:32:05.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20702025-01-06T20:32:05.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20712025-01-06T20:32:05.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20722025-01-06T20:32:05.486ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20732025-01-06T20:32:05.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20742025-01-06T20:32:05.493ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 503.321161ms iteration = 8 status = {}
20752025-01-06T20:32:05.540ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
20762025-01-06T20:32:05.540ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
20772025-01-06T20:32:05.571ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
20782025-01-06T20:32:05.571ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:50040
20792025-01-06T20:32:05.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50040 req_id = fc34bee8-dd68-4ac5-bf2a-0406ec5c10bc roles = RoleSet { roles: {} } uri = /metrics/producers
20802025-01-06T20:32:05.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50040 req_id = fc34bee8-dd68-4ac5-bf2a-0406ec5c10bc resource = Database result = Ok(()) uri = /metrics/producers
20812025-01-06T20:32:05.612ZINFOnexus: assigned collector to new producer collector_id = 3aa155a2-91f9-44a1-9f26-4a40e0aef546 file = nexus/src/app/oximeter.rs:76 producer_id = d4581482-c7a8-479c-a435-cf6d95b38f96
20822025-01-06T20:32:05.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40844 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50040 req_id = fc34bee8-dd68-4ac5-bf2a-0406ec5c10bc response_code = 201 uri = /metrics/producers
20832025-01-06T20:32:05.612ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "fc34bee8-dd68-4ac5-bf2a-0406ec5c10bc", "content-length": "41", "date": "Mon, 06 Jan 2025 20:32:05 GMT"} })
20842025-01-06T20:32:05.614ZDEBGnexus (producer-registration-task): registered with nexus successfully
20852025-01-06T20:32:05.614ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
20862025-01-06T20:32:05.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 137ad8de-ea63-4791-8048-149ad2d48477 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
20872025-01-06T20:32:05.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 137ad8de-ea63-4791-8048-149ad2d48477 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
20882025-01-06T20:32:05.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 137ad8de-ea63-4791-8048-149ad2d48477 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
20892025-01-06T20:32:06.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4bc78cad-d5c6-419b-be83-32f7e6f632e4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
20902025-01-06T20:32:06.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4bc78cad-d5c6-419b-be83-32f7e6f632e4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
20912025-01-06T20:32:06.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1835 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4bc78cad-d5c6-419b-be83-32f7e6f632e4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
20922025-01-06T20:32:07.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 505 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 9b1541fd-fdf2-434c-b14b-93613ba2fee4 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
20932025-01-06T20:32:07.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e810c31f-7518-4f1c-a19f-e1415d331297 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
20942025-01-06T20:32:07.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e810c31f-7518-4f1c-a19f-e1415d331297 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
20952025-01-06T20:32:07.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e810c31f-7518-4f1c-a19f-e1415d331297 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
20962025-01-06T20:32:08.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0e4480dd-825b-47b3-bf1b-f54d06d6a420 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
20972025-01-06T20:32:08.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0e4480dd-825b-47b3-bf1b-f54d06d6a420 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
20982025-01-06T20:32:08.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0e4480dd-825b-47b3-bf1b-f54d06d6a420 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
20992025-01-06T20:32:09.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 89844914-5ff4-4de9-9115-dd103e7955b7 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21002025-01-06T20:32:09.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 89844914-5ff4-4de9-9115-dd103e7955b7 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21012025-01-06T20:32:09.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 89844914-5ff4-4de9-9115-dd103e7955b7 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21022025-01-06T20:32:10.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 43506395-a74c-4ebf-b37d-608a7e57f6fc roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21032025-01-06T20:32:10.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 43506395-a74c-4ebf-b37d-608a7e57f6fc resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21042025-01-06T20:32:10.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 43506395-a74c-4ebf-b37d-608a7e57f6fc response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21052025-01-06T20:32:11.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 54f923c1-ce83-425b-9b1d-e6d45b7b9c44 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21062025-01-06T20:32:11.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 54f923c1-ce83-425b-9b1d-e6d45b7b9c44 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21072025-01-06T20:32:11.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1846 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 54f923c1-ce83-425b-9b1d-e6d45b7b9c44 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21082025-01-06T20:32:12.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f968bfe2-2d6c-4141-b3d2-533f0de9e2da roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21092025-01-06T20:32:12.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f968bfe2-2d6c-4141-b3d2-533f0de9e2da resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21102025-01-06T20:32:12.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f968bfe2-2d6c-4141-b3d2-533f0de9e2da response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21112025-01-06T20:32:13.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e63872be-e090-4f74-a298-1b2d02749049 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21122025-01-06T20:32:13.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e63872be-e090-4f74-a298-1b2d02749049 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21132025-01-06T20:32:13.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e63872be-e090-4f74-a298-1b2d02749049 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21142025-01-06T20:32:14.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = db62bbe3-33c8-45aa-b473-e5dd13cfba7d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21152025-01-06T20:32:14.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = db62bbe3-33c8-45aa-b473-e5dd13cfba7d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21162025-01-06T20:32:14.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = db62bbe3-33c8-45aa-b473-e5dd13cfba7d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21172025-01-06T20:32:14.989ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
21182025-01-06T20:32:14.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21192025-01-06T20:32:14.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21202025-01-06T20:32:14.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
21212025-01-06T20:32:14.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21222025-01-06T20:32:14.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21232025-01-06T20:32:14.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21242025-01-06T20:32:14.992ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21252025-01-06T20:32:14.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21262025-01-06T20:32:14.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21272025-01-06T20:32:14.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21282025-01-06T20:32:14.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21292025-01-06T20:32:14.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21302025-01-06T20:32:14.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21312025-01-06T20:32:14.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21322025-01-06T20:32:15.002ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
21332025-01-06T20:32:15.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21342025-01-06T20:32:15.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21352025-01-06T20:32:15.020ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
21362025-01-06T20:32:15.020ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.813019ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
21372025-01-06T20:32:15.025ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.467485ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21382025-01-06T20:32:15.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a304cb74-6f3a-4828-8063-b1d14ff4707c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21392025-01-06T20:32:15.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a304cb74-6f3a-4828-8063-b1d14ff4707c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21402025-01-06T20:32:15.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a304cb74-6f3a-4828-8063-b1d14ff4707c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21412025-01-06T20:32:16.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6f1c24c8-e2a7-44a0-8eeb-10fa48dfcdb2 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21422025-01-06T20:32:16.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6f1c24c8-e2a7-44a0-8eeb-10fa48dfcdb2 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21432025-01-06T20:32:16.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6f1c24c8-e2a7-44a0-8eeb-10fa48dfcdb2 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21442025-01-06T20:32:17.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 550 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = ab886758-41c8-4391-8e05-43e6cb48d00b response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
21452025-01-06T20:32:17.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1bacbac5-46e9-4785-b443-71e74f3c9585 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21462025-01-06T20:32:17.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1bacbac5-46e9-4785-b443-71e74f3c9585 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21472025-01-06T20:32:17.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1bacbac5-46e9-4785-b443-71e74f3c9585 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21482025-01-06T20:32:19.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e6b51aae-f273-4c62-a01e-ddb4db79c653 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21492025-01-06T20:32:19.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e6b51aae-f273-4c62-a01e-ddb4db79c653 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21502025-01-06T20:32:19.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e6b51aae-f273-4c62-a01e-ddb4db79c653 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21512025-01-06T20:32:20.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 54afc464-b30e-44e5-8e4a-e2c51001de85 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21522025-01-06T20:32:20.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 54afc464-b30e-44e5-8e4a-e2c51001de85 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21532025-01-06T20:32:20.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 54afc464-b30e-44e5-8e4a-e2c51001de85 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21542025-01-06T20:32:21.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0d50c683-9ea5-4499-b997-b268aaa96416 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21552025-01-06T20:32:21.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0d50c683-9ea5-4499-b997-b268aaa96416 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21562025-01-06T20:32:21.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0d50c683-9ea5-4499-b997-b268aaa96416 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21572025-01-06T20:32:22.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 48803d1b-7b10-4e89-ae15-41c61e4df769 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21582025-01-06T20:32:22.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 48803d1b-7b10-4e89-ae15-41c61e4df769 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21592025-01-06T20:32:22.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 48803d1b-7b10-4e89-ae15-41c61e4df769 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21602025-01-06T20:32:23.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2c345671-c9ec-4d6c-ade5-6afee6adf7ae roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21612025-01-06T20:32:23.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2c345671-c9ec-4d6c-ade5-6afee6adf7ae resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21622025-01-06T20:32:23.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2c345671-c9ec-4d6c-ade5-6afee6adf7ae response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21632025-01-06T20:32:24.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b9f7ef2b-1823-42a3-84ed-ad98c70b6c1d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21642025-01-06T20:32:24.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b9f7ef2b-1823-42a3-84ed-ad98c70b6c1d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21652025-01-06T20:32:24.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2639 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b9f7ef2b-1823-42a3-84ed-ad98c70b6c1d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21662025-01-06T20:32:24.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
21672025-01-06T20:32:24.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21682025-01-06T20:32:24.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21692025-01-06T20:32:24.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
21702025-01-06T20:32:24.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21712025-01-06T20:32:24.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21722025-01-06T20:32:24.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21732025-01-06T20:32:24.991ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21742025-01-06T20:32:24.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21752025-01-06T20:32:24.993ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.146606ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21762025-01-06T20:32:24.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21772025-01-06T20:32:24.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21782025-01-06T20:32:24.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21792025-01-06T20:32:24.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21802025-01-06T20:32:24.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21812025-01-06T20:32:24.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21822025-01-06T20:32:24.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
21832025-01-06T20:32:24.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21842025-01-06T20:32:24.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21852025-01-06T20:32:25.011ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
21862025-01-06T20:32:25.011ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.636466ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
21872025-01-06T20:32:25.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 18196e45-cc32-47f5-9453-d39d473242d8 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21882025-01-06T20:32:25.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 18196e45-cc32-47f5-9453-d39d473242d8 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21892025-01-06T20:32:25.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 18196e45-cc32-47f5-9453-d39d473242d8 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21902025-01-06T20:32:26.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cd6e4792-2c55-462d-b787-d88990e39508 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21912025-01-06T20:32:26.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cd6e4792-2c55-462d-b787-d88990e39508 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21922025-01-06T20:32:26.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cd6e4792-2c55-462d-b787-d88990e39508 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21932025-01-06T20:32:27.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d3d490a3-3aee-4a67-9bd2-5b31ecb41b09 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21942025-01-06T20:32:27.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d3d490a3-3aee-4a67-9bd2-5b31ecb41b09 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21952025-01-06T20:32:27.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d3d490a3-3aee-4a67-9bd2-5b31ecb41b09 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21962025-01-06T20:32:27.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 557 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 69272474-d716-42af-8364-ff73a6896054 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
21972025-01-06T20:32:28.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ae870e6d-a62d-4698-99f3-56e597449b54 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21982025-01-06T20:32:28.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ae870e6d-a62d-4698-99f3-56e597449b54 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
21992025-01-06T20:32:28.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ae870e6d-a62d-4698-99f3-56e597449b54 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22002025-01-06T20:32:29.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 71283255-5759-4049-957b-cf006aec2faf roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22012025-01-06T20:32:29.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 71283255-5759-4049-957b-cf006aec2faf resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22022025-01-06T20:32:29.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 71283255-5759-4049-957b-cf006aec2faf response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22032025-01-06T20:32:30.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 549a4c4b-6acc-4422-9a5f-065f0c3dfa3c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22042025-01-06T20:32:30.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 549a4c4b-6acc-4422-9a5f-065f0c3dfa3c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22052025-01-06T20:32:30.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 549a4c4b-6acc-4422-9a5f-065f0c3dfa3c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22062025-01-06T20:32:31.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f4fa0225-a64d-4b9c-a283-3c7c95b1745c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22072025-01-06T20:32:31.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f4fa0225-a64d-4b9c-a283-3c7c95b1745c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22082025-01-06T20:32:31.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2737 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f4fa0225-a64d-4b9c-a283-3c7c95b1745c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22092025-01-06T20:32:32.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 53750956-4d57-46e3-8526-c6123263c044 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22102025-01-06T20:32:32.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 53750956-4d57-46e3-8526-c6123263c044 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22112025-01-06T20:32:32.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 53750956-4d57-46e3-8526-c6123263c044 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22122025-01-06T20:32:33.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e455e137-4b82-4ab8-a12d-9eadcecd67e2 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22132025-01-06T20:32:33.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e455e137-4b82-4ab8-a12d-9eadcecd67e2 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22142025-01-06T20:32:33.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e455e137-4b82-4ab8-a12d-9eadcecd67e2 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22152025-01-06T20:32:34.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b57366b4-75b6-4e79-a74b-620f606e6c62 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22162025-01-06T20:32:34.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b57366b4-75b6-4e79-a74b-620f606e6c62 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22172025-01-06T20:32:34.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b57366b4-75b6-4e79-a74b-620f606e6c62 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
22182025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
22192025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
22202025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
22212025-01-06T20:32:34.988ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-06 20:22:34.988612638 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
22222025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
22232025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22242025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
22252025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
22262025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
22272025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22282025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
22292025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
22302025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
22312025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22322025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22332025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22342025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
22352025-01-06T20:32:34.988ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468
22362025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.66\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468"}
22372025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
22382025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
22392025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
22402025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
22412025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22422025-01-06T20:32:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
22432025-01-06T20:32:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22442025-01-06T20:32:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22452025-01-06T20:32:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22462025-01-06T20:32:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22472025-01-06T20:32:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
22482025-01-06T20:32:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22492025-01-06T20:32:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22502025-01-06T20:32:34.989ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65bacdd1-9837-48ad-941c-aec5e2d79006.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 997, tv_nsec: 677155846 } })
22512025-01-06T20:32:34.989ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("88aaaee6-38b4-4a83-9c08-04f0ea18e003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8dd67555-06fb-4cef-b914-9650f0eeb68a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 997, tv_nsec: 677338181 } })
22522025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
22532025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
22542025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22552025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22562025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
22572025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22582025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
22592025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22602025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
22612025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
22622025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
22632025-01-06T20:32:34.990ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
22642025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22652025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
22662025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22672025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
22682025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22692025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
22702025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
22712025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
22722025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22732025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22742025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
22752025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22762025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
22772025-01-06T20:32:34.990ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22782025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22792025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
22802025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22812025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
22822025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
22832025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
22842025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
22852025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
22862025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22872025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
22882025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
22892025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22902025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22912025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22922025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
22932025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.48828ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
22942025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
22952025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22962025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22972025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22982025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22992025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23002025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23012025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23022025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
23032025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23042025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23052025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
23062025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23072025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
23082025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.745478ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
23092025-01-06T20:32:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
23102025-01-06T20:32:34.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23112025-01-06T20:32:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23122025-01-06T20:32:34.992ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 997, tv_nsec: 680857867 } })
23132025-01-06T20:32:34.993ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
23142025-01-06T20:32:34.993ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 997, tv_nsec: 681338210 } })
23152025-01-06T20:32:34.993ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
23162025-01-06T20:32:34.994ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23172025-01-06T20:32:34.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23182025-01-06T20:32:34.994ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.657704ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
23192025-01-06T20:32:34.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23202025-01-06T20:32:34.995ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23212025-01-06T20:32:34.995ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-06 20:22:34.988612638 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
23222025-01-06T20:32:34.995ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.545078ms iteration = 5 status = {"expiration":"2025-01-06T20:22:34.988612638Z","pruned":[]}
23232025-01-06T20:32:34.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23242025-01-06T20:32:34.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23252025-01-06T20:32:34.998ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23262025-01-06T20:32:34.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23272025-01-06T20:32:34.998ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23282025-01-06T20:32:34.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23292025-01-06T20:32:34.999ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23302025-01-06T20:32:35.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23312025-01-06T20:32:35.000ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.867145ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
23322025-01-06T20:32:35.001ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23332025-01-06T20:32:35.002ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23342025-01-06T20:32:35.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23352025-01-06T20:32:35.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23362025-01-06T20:32:35.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23372025-01-06T20:32:35.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23382025-01-06T20:32:35.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23392025-01-06T20:32:35.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23402025-01-06T20:32:35.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23412025-01-06T20:32:35.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23422025-01-06T20:32:35.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23432025-01-06T20:32:35.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23442025-01-06T20:32:35.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23452025-01-06T20:32:35.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23462025-01-06T20:32:35.022ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23472025-01-06T20:32:35.024ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23482025-01-06T20:32:35.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23492025-01-06T20:32:35.025ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 35.381323ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23502025-01-06T20:32:35.026ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23512025-01-06T20:32:35.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23522025-01-06T20:32:35.026ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23532025-01-06T20:32:35.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23542025-01-06T20:32:35.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23552025-01-06T20:32:35.028ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 997, tv_nsec: 716524978 } })
23562025-01-06T20:32:35.028ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
23572025-01-06T20:32:35.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23582025-01-06T20:32:35.030ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
23592025-01-06T20:32:35.030ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
23602025-01-06T20:32:35.030ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
23612025-01-06T20:32:35.030ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23622025-01-06T20:32:35.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23632025-01-06T20:32:35.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
23642025-01-06T20:32:35.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23652025-01-06T20:32:35.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23662025-01-06T20:32:35.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23672025-01-06T20:32:35.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23682025-01-06T20:32:35.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23692025-01-06T20:32:35.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23702025-01-06T20:32:35.056ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23712025-01-06T20:32:35.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23722025-01-06T20:32:35.057ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
23732025-01-06T20:32:35.057ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
23742025-01-06T20:32:35.057ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23752025-01-06T20:32:35.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23762025-01-06T20:32:35.062ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.786211ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23772025-01-06T20:32:35.064ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23782025-01-06T20:32:35.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23792025-01-06T20:32:35.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23802025-01-06T20:32:35.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23812025-01-06T20:32:35.072ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23822025-01-06T20:32:35.072ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23832025-01-06T20:32:35.072ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23842025-01-06T20:32:35.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23852025-01-06T20:32:35.076ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23862025-01-06T20:32:35.076ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23872025-01-06T20:32:35.076ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
23882025-01-06T20:32:35.076ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23892025-01-06T20:32:35.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 87.06081ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
23902025-01-06T20:32:35.077ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23912025-01-06T20:32:35.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23922025-01-06T20:32:35.077ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
23932025-01-06T20:32:35.077ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
23942025-01-06T20:32:35.077ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-06 20:28:35.848690 UTC dns_group = internal generation = 1
23952025-01-06T20:32:35.077ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 89.099545ms iteration = 5 status = {"generation":1}
23962025-01-06T20:32:35.078ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23972025-01-06T20:32:35.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23982025-01-06T20:32:35.078ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
23992025-01-06T20:32:35.078ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.156834ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
24002025-01-06T20:32:35.078ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24012025-01-06T20:32:35.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
24022025-01-06T20:32:35.080ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24032025-01-06T20:32:35.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24042025-01-06T20:32:35.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24052025-01-06T20:32:35.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24062025-01-06T20:32:35.081ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24072025-01-06T20:32:35.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24082025-01-06T20:32:35.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24092025-01-06T20:32:35.081ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 92.028815ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
24102025-01-06T20:32:35.082ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24112025-01-06T20:32:35.082ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24122025-01-06T20:32:35.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24132025-01-06T20:32:35.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24142025-01-06T20:32:35.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24152025-01-06T20:32:35.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24162025-01-06T20:32:35.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24172025-01-06T20:32:35.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24182025-01-06T20:32:35.089ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24192025-01-06T20:32:35.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24202025-01-06T20:32:35.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24212025-01-06T20:32:35.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24222025-01-06T20:32:35.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24232025-01-06T20:32:35.091ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24242025-01-06T20:32:35.092ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24252025-01-06T20:32:35.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
24262025-01-06T20:32:35.096ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24272025-01-06T20:32:35.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24282025-01-06T20:32:35.096ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
24292025-01-06T20:32:35.096ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
24302025-01-06T20:32:35.096ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
24312025-01-06T20:32:35.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
24322025-01-06T20:32:35.096ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24332025-01-06T20:32:35.096ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24342025-01-06T20:32:35.096ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
24352025-01-06T20:32:35.096ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
24362025-01-06T20:32:35.097ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 107.026724ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
24372025-01-06T20:32:35.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24382025-01-06T20:32:35.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24392025-01-06T20:32:35.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24402025-01-06T20:32:35.099ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.875061ms iteration = 9 status = 0
24412025-01-06T20:32:35.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24422025-01-06T20:32:35.103ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24432025-01-06T20:32:35.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24442025-01-06T20:32:35.124ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24452025-01-06T20:32:35.124ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 134.350047ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24462025-01-06T20:32:35.132ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
24472025-01-06T20:32:35.132ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24482025-01-06T20:32:35.132ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ba1c3c4-271a-45cc-add3-8a25fbef1ec5", "content-length": "26", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} })
24492025-01-06T20:32:35.132ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24502025-01-06T20:32:35.135ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24512025-01-06T20:32:35.141ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24522025-01-06T20:32:35.142ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24532025-01-06T20:32:35.142ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 152.191293ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24542025-01-06T20:32:35.144ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24552025-01-06T20:32:35.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24562025-01-06T20:32:35.147ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24572025-01-06T20:32:35.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24582025-01-06T20:32:35.150ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24592025-01-06T20:32:35.150ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
24602025-01-06T20:32:35.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24612025-01-06T20:32:35.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24622025-01-06T20:32:35.152ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24632025-01-06T20:32:35.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24642025-01-06T20:32:35.153ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
24652025-01-06T20:32:35.153ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
24662025-01-06T20:32:35.153ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 163.903621ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
24672025-01-06T20:32:35.158ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 168.415135ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
24682025-01-06T20:32:35.158ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24692025-01-06T20:32:35.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24702025-01-06T20:32:35.161ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24712025-01-06T20:32:35.163ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
24722025-01-06T20:32:35.163ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 0 version = 2
24732025-01-06T20:32:35.163ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24742025-01-06T20:32:35.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24752025-01-06T20:32:35.164ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24762025-01-06T20:32:35.164ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24772025-01-06T20:32:35.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24782025-01-06T20:32:35.165ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24792025-01-06T20:32:35.167ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24802025-01-06T20:32:35.167ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 177.358678ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24812025-01-06T20:32:35.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24822025-01-06T20:32:35.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24832025-01-06T20:32:35.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24842025-01-06T20:32:35.171ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
24852025-01-06T20:32:35.171ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 1 version = 2
24862025-01-06T20:32:35.171ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
24872025-01-06T20:32:35.171ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-06 20:28:37.181288 UTC dns_group = external generation = 2
24882025-01-06T20:32:35.171ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 183.088764ms iteration = 5 status = {"generation":2}
24892025-01-06T20:32:35.200ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24902025-01-06T20:32:35.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24912025-01-06T20:32:35.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24922025-01-06T20:32:35.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24932025-01-06T20:32:35.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24942025-01-06T20:32:35.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24952025-01-06T20:32:35.208ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24962025-01-06T20:32:35.211ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24972025-01-06T20:32:35.211ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24982025-01-06T20:32:35.211ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
24992025-01-06T20:32:35.211ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25002025-01-06T20:32:35.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25012025-01-06T20:32:35.212ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d10454e-e822-402d-964c-476b83e79e35", "content-length": "26", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} })
25022025-01-06T20:32:35.212ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25032025-01-06T20:32:35.214ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25042025-01-06T20:32:35.214ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-06T20:28:32.843602Z, time_modified: 2025-01-06T20:28:32.843602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }) }
25052025-01-06T20:32:35.214ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 226.138356ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]}},"default_endpoint":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
25062025-01-06T20:32:35.282ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
25072025-01-06T20:32:35.319ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
25082025-01-06T20:32:35.319ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 329.825189ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
25092025-01-06T20:32:35.327ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 337.468837ms iteration = 11 status = {"physical_disks_added":0}
25102025-01-06T20:32:35.329ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
25112025-01-06T20:32:35.329ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25122025-01-06T20:32:35.329ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa956b4b-08fb-4809-b557-e133700e9f0f", "content-length": "26", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} })
25132025-01-06T20:32:35.329ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25142025-01-06T20:32:35.338ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
25152025-01-06T20:32:35.350ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 361.890971ms iteration = 9 status = {}
25162025-01-06T20:32:35.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 12f75dd4-1af8-4a33-9ab8-177c3d0b5a4e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
25172025-01-06T20:32:35.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 12f75dd4-1af8-4a33-9ab8-177c3d0b5a4e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
25182025-01-06T20:32:35.406ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25192025-01-06T20:32:35.407ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3f474854-ebd3-48fe-9e70-8ddd6115c255", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25202025-01-06T20:32:35.407ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25212025-01-06T20:32:35.409ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "35e460fe-ce0b-4354-a17b-4dcd22c94e5a", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25222025-01-06T20:32:35.409ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25232025-01-06T20:32:35.411ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25242025-01-06T20:32:35.411ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 422.731717ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
25252025-01-06T20:32:35.430ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
25262025-01-06T20:32:35.430ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b64e307f-10dd-444e-b553-c3434aedb72b", "content-length": "1", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} })
25272025-01-06T20:32:35.432ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25282025-01-06T20:32:35.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25292025-01-06T20:32:35.444ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
25302025-01-06T20:32:35.444ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "18d71453-2895-4ed8-b2d7-9cba1d06bad0", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25312025-01-06T20:32:35.444ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25322025-01-06T20:32:35.447ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "58920cdc-b0a6-4c60-b4b4-c4039038e68c", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25332025-01-06T20:32:35.447ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25342025-01-06T20:32:35.449ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4e228362-fe2f-456f-a7a8-df8d3928c84b", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25352025-01-06T20:32:35.449ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25362025-01-06T20:32:35.451ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25372025-01-06T20:32:35.451ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 462.387047ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
25382025-01-06T20:32:35.534ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
25392025-01-06T20:32:35.535ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25402025-01-06T20:32:35.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185368 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 12f75dd4-1af8-4a33-9ab8-177c3d0b5a4e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
25412025-01-06T20:32:35.537ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
25422025-01-06T20:32:35.538ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 549.425735ms iteration = 9 status = null
25432025-01-06T20:32:35.588ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25442025-01-06T20:32:35.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25452025-01-06T20:32:35.590ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
25462025-01-06T20:32:35.590ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25472025-01-06T20:32:35.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25482025-01-06T20:32:35.603ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25492025-01-06T20:32:35.603ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c702e530-2413-414b-8371-e4d1963a8f19", "content-length": "134", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} })
25502025-01-06T20:32:35.603ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
25512025-01-06T20:32:35.603ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
25522025-01-06T20:32:35.604ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
25532025-01-06T20:32:35.604ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
25542025-01-06T20:32:35.604ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25552025-01-06T20:32:35.604ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25562025-01-06T20:32:35.604ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25572025-01-06T20:32:35.604ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25582025-01-06T20:32:35.604ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25592025-01-06T20:32:35.604ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25602025-01-06T20:32:35.604ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
25612025-01-06T20:32:35.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25622025-01-06T20:32:35.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25632025-01-06T20:32:35.607ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25642025-01-06T20:32:35.607ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "159f12a4-b941-4e83-a7f2-7175c8ed7c1f", "content-length": "2", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} })
25652025-01-06T20:32:35.607ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
25662025-01-06T20:32:35.607ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "156ad0b3-487e-4d44-b5c4-1d7b83ed902b", "content-length": "52", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} })
25672025-01-06T20:32:35.607ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
25682025-01-06T20:32:35.607ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25692025-01-06T20:32:35.652ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e91197b0-c1e0-48eb-87fd-fc70fa2d9fba", "content-length": "372", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} })
25702025-01-06T20:32:35.652ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25712025-01-06T20:32:35.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25722025-01-06T20:32:35.658ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "23119628-b92c-4853-8ec4-fa46345fd70c", "content-length": "691", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} })
25732025-01-06T20:32:35.658ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
25742025-01-06T20:32:35.658ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
25752025-01-06T20:32:35.658ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
25762025-01-06T20:32:35.660ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 670.479792ms iteration = 9 status = {}
25772025-01-06T20:32:35.705ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
25782025-01-06T20:32:35.705ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
25792025-01-06T20:32:35.706ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0ad184fb-3276-4305-a52e-e74999cb49ca", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} })
25802025-01-06T20:32:35.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25812025-01-06T20:32:35.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25822025-01-06T20:32:35.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25832025-01-06T20:32:35.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25842025-01-06T20:32:35.714ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25852025-01-06T20:32:35.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25862025-01-06T20:32:35.718ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
25872025-01-06T20:32:35.718ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25882025-01-06T20:32:35.719ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c0952004-1422-473f-b5da-a12030827c08", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} })
25892025-01-06T20:32:35.721ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 732.041756ms iteration = 9 status = {}
25902025-01-06T20:32:35.777ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a7ed76cc-585b-45ae-a890-681a5c7c66d3", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} })
25912025-01-06T20:32:35.777ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
25922025-01-06T20:32:35.777ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25932025-01-06T20:32:35.777ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6d139fd-9fcb-49e2-93ee-162352953d28", "content-length": "682", "date": "Mon, 06 Jan 2025 20:32:35 GMT"} })
25942025-01-06T20:32:35.777ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25952025-01-06T20:32:35.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25962025-01-06T20:32:35.782ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25972025-01-06T20:32:35.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25982025-01-06T20:32:35.786ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25992025-01-06T20:32:35.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26002025-01-06T20:32:35.789ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26012025-01-06T20:32:35.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26022025-01-06T20:32:35.799ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 809.870746ms iteration = 9 status = {}
26032025-01-06T20:32:36.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8c8285b9-75f6-462c-9676-c8d84828add9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26042025-01-06T20:32:36.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8c8285b9-75f6-462c-9676-c8d84828add9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26052025-01-06T20:32:36.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8c8285b9-75f6-462c-9676-c8d84828add9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26062025-01-06T20:32:37.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 65abf2f3-e144-48c3-ae22-21b189e4e9eb roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26072025-01-06T20:32:37.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 65abf2f3-e144-48c3-ae22-21b189e4e9eb resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26082025-01-06T20:32:37.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 65abf2f3-e144-48c3-ae22-21b189e4e9eb response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26092025-01-06T20:32:37.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 491 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 3b5cdce9-ed97-41d9-b227-49315b1ac669 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
26102025-01-06T20:32:38.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 24c47f8a-523a-4c53-a811-c9b0f732f09e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26112025-01-06T20:32:38.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 24c47f8a-523a-4c53-a811-c9b0f732f09e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26122025-01-06T20:32:38.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 24c47f8a-523a-4c53-a811-c9b0f732f09e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26132025-01-06T20:32:39.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3deb6ccc-d8dd-4bb5-8904-3bdb69caab16 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26142025-01-06T20:32:39.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3deb6ccc-d8dd-4bb5-8904-3bdb69caab16 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26152025-01-06T20:32:39.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3deb6ccc-d8dd-4bb5-8904-3bdb69caab16 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26162025-01-06T20:32:40.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b3d3a975-8883-4cfb-ae4c-a0a259d7375c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26172025-01-06T20:32:40.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b3d3a975-8883-4cfb-ae4c-a0a259d7375c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26182025-01-06T20:32:40.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b3d3a975-8883-4cfb-ae4c-a0a259d7375c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26192025-01-06T20:32:41.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2938fc3e-f53d-4058-84a3-fdbac0e94b91 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26202025-01-06T20:32:41.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2938fc3e-f53d-4058-84a3-fdbac0e94b91 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26212025-01-06T20:32:41.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2938fc3e-f53d-4058-84a3-fdbac0e94b91 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26222025-01-06T20:32:42.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e29e2365-c4e9-49d1-82ab-ec39d664214c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26232025-01-06T20:32:42.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e29e2365-c4e9-49d1-82ab-ec39d664214c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26242025-01-06T20:32:42.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e29e2365-c4e9-49d1-82ab-ec39d664214c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26252025-01-06T20:32:43.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 63dd0bf4-4d7d-4536-9298-7baf824ec42f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26262025-01-06T20:32:43.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 63dd0bf4-4d7d-4536-9298-7baf824ec42f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26272025-01-06T20:32:43.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 63dd0bf4-4d7d-4536-9298-7baf824ec42f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26282025-01-06T20:32:44.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fc011e8a-324b-4910-9e0f-870bfa72ee5d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26292025-01-06T20:32:44.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fc011e8a-324b-4910-9e0f-870bfa72ee5d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26302025-01-06T20:32:44.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fc011e8a-324b-4910-9e0f-870bfa72ee5d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26312025-01-06T20:32:44.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
26322025-01-06T20:32:44.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26332025-01-06T20:32:44.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26342025-01-06T20:32:44.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
26352025-01-06T20:32:44.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26362025-01-06T20:32:44.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26372025-01-06T20:32:44.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26382025-01-06T20:32:44.991ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26392025-01-06T20:32:44.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26402025-01-06T20:32:44.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26412025-01-06T20:32:44.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26422025-01-06T20:32:44.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26432025-01-06T20:32:44.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26442025-01-06T20:32:44.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26452025-01-06T20:32:44.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26462025-01-06T20:32:44.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
26472025-01-06T20:32:44.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26482025-01-06T20:32:44.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26492025-01-06T20:32:45.009ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
26502025-01-06T20:32:45.009ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.056243ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
26512025-01-06T20:32:45.027ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.773178ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26522025-01-06T20:32:45.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 91fa6365-fe67-4530-9a86-17530f864d74 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26532025-01-06T20:32:45.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 91fa6365-fe67-4530-9a86-17530f864d74 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26542025-01-06T20:32:45.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 91fa6365-fe67-4530-9a86-17530f864d74 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26552025-01-06T20:32:46.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 144b9851-7996-46ab-973f-0e384a6b8eae roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26562025-01-06T20:32:46.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 144b9851-7996-46ab-973f-0e384a6b8eae resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26572025-01-06T20:32:46.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 144b9851-7996-46ab-973f-0e384a6b8eae response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26582025-01-06T20:32:47.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 494 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = b9bae40a-bfb3-4a4d-a219-061e92377aa6 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
26592025-01-06T20:32:47.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 54b08c9e-3da8-489c-83f4-1a992097a18c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26602025-01-06T20:32:47.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 54b08c9e-3da8-489c-83f4-1a992097a18c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26612025-01-06T20:32:47.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 54b08c9e-3da8-489c-83f4-1a992097a18c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26622025-01-06T20:32:48.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 991eaed1-38ea-474a-ad42-2dd7fca10ac4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26632025-01-06T20:32:48.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 991eaed1-38ea-474a-ad42-2dd7fca10ac4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26642025-01-06T20:32:48.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 991eaed1-38ea-474a-ad42-2dd7fca10ac4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26652025-01-06T20:32:49.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c0b36d91-9b44-4ff0-8117-c8e4f5fb96a5 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26662025-01-06T20:32:49.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c0b36d91-9b44-4ff0-8117-c8e4f5fb96a5 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26672025-01-06T20:32:49.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c0b36d91-9b44-4ff0-8117-c8e4f5fb96a5 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26682025-01-06T20:32:50.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2cdd83e7-4272-4bb8-bc72-45fd9fd88144 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26692025-01-06T20:32:50.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2cdd83e7-4272-4bb8-bc72-45fd9fd88144 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26702025-01-06T20:32:50.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2cdd83e7-4272-4bb8-bc72-45fd9fd88144 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26712025-01-06T20:32:52.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b586a3da-18b3-49c0-ba1a-bf26362326d3 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26722025-01-06T20:32:52.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b586a3da-18b3-49c0-ba1a-bf26362326d3 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26732025-01-06T20:32:52.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b586a3da-18b3-49c0-ba1a-bf26362326d3 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26742025-01-06T20:32:53.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 364b8f6e-e460-43e6-8d7c-cf6041fa9235 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26752025-01-06T20:32:53.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 364b8f6e-e460-43e6-8d7c-cf6041fa9235 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26762025-01-06T20:32:53.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 364b8f6e-e460-43e6-8d7c-cf6041fa9235 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26772025-01-06T20:32:54.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a3571cdc-69bd-439e-af16-a6f55e2d55bc roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26782025-01-06T20:32:54.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a3571cdc-69bd-439e-af16-a6f55e2d55bc resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26792025-01-06T20:32:54.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a3571cdc-69bd-439e-af16-a6f55e2d55bc response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
26802025-01-06T20:32:54.989ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
26812025-01-06T20:32:54.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26822025-01-06T20:32:54.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26832025-01-06T20:32:54.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
26842025-01-06T20:32:54.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26852025-01-06T20:32:54.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26862025-01-06T20:32:54.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26872025-01-06T20:32:54.992ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26882025-01-06T20:32:54.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26892025-01-06T20:32:54.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26902025-01-06T20:32:54.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26912025-01-06T20:32:54.994ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.39993ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26922025-01-06T20:32:54.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26932025-01-06T20:32:54.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26942025-01-06T20:32:54.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26952025-01-06T20:32:54.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26962025-01-06T20:32:54.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
26972025-01-06T20:32:54.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26982025-01-06T20:32:54.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26992025-01-06T20:32:55.007ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
27002025-01-06T20:32:55.007ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.99341ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
27012025-01-06T20:32:55.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 86a9c4db-e374-47f5-868d-439eb9f07f8e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27022025-01-06T20:32:55.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 86a9c4db-e374-47f5-868d-439eb9f07f8e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27032025-01-06T20:32:55.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 86a9c4db-e374-47f5-868d-439eb9f07f8e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27042025-01-06T20:32:56.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 30ebf020-889d-4df9-a5bb-ea893bf6301a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27052025-01-06T20:32:56.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 30ebf020-889d-4df9-a5bb-ea893bf6301a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27062025-01-06T20:32:56.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 30ebf020-889d-4df9-a5bb-ea893bf6301a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27072025-01-06T20:32:57.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b29b6de3-0f63-4e0e-bf37-d3bd57e4ee0b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27082025-01-06T20:32:57.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b29b6de3-0f63-4e0e-bf37-d3bd57e4ee0b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27092025-01-06T20:32:57.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b29b6de3-0f63-4e0e-bf37-d3bd57e4ee0b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27102025-01-06T20:32:57.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 481 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = fad383ec-d788-4596-baa4-7156d6c9072f response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
27112025-01-06T20:32:58.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 987d45d5-ac7a-4e16-b472-5755eb232982 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27122025-01-06T20:32:58.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 987d45d5-ac7a-4e16-b472-5755eb232982 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27132025-01-06T20:32:58.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 987d45d5-ac7a-4e16-b472-5755eb232982 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27142025-01-06T20:32:59.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f7b9f8b8-bfc5-4291-8617-4ed2b974f46d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27152025-01-06T20:32:59.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f7b9f8b8-bfc5-4291-8617-4ed2b974f46d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27162025-01-06T20:32:59.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f7b9f8b8-bfc5-4291-8617-4ed2b974f46d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27172025-01-06T20:33:00.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dcbce442-5cc1-4c1c-9ebd-616d5c6f2cd7 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27182025-01-06T20:33:00.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dcbce442-5cc1-4c1c-9ebd-616d5c6f2cd7 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27192025-01-06T20:33:00.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dcbce442-5cc1-4c1c-9ebd-616d5c6f2cd7 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27202025-01-06T20:33:01.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0566a044-649d-4868-beaa-2fa822b556c8 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27212025-01-06T20:33:01.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0566a044-649d-4868-beaa-2fa822b556c8 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27222025-01-06T20:33:01.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0566a044-649d-4868-beaa-2fa822b556c8 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27232025-01-06T20:33:02.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1fe72a0d-2461-4fea-8711-d5b711e62d3b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27242025-01-06T20:33:02.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1fe72a0d-2461-4fea-8711-d5b711e62d3b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27252025-01-06T20:33:02.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2624 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1fe72a0d-2461-4fea-8711-d5b711e62d3b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27262025-01-06T20:33:03.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1322d313-9f21-42fe-9120-8743af347b00 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27272025-01-06T20:33:03.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1322d313-9f21-42fe-9120-8743af347b00 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27282025-01-06T20:33:03.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1322d313-9f21-42fe-9120-8743af347b00 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27292025-01-06T20:33:04.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bee7220f-16b3-4e6c-bb2c-0d6484950f58 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27302025-01-06T20:33:04.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bee7220f-16b3-4e6c-bb2c-0d6484950f58 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27312025-01-06T20:33:04.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bee7220f-16b3-4e6c-bb2c-0d6484950f58 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
27322025-01-06T20:33:04.988ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
27332025-01-06T20:33:04.988ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
27342025-01-06T20:33:04.988ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27352025-01-06T20:33:04.988ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
27362025-01-06T20:33:04.988ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
27372025-01-06T20:33:04.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
27382025-01-06T20:33:04.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27392025-01-06T20:33:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27402025-01-06T20:33:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27412025-01-06T20:33:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27422025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
27432025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
27442025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27452025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27462025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
27472025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
27482025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
27492025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27502025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27512025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
27522025-01-06T20:33:04.990ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
27532025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27542025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
27552025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
27562025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27572025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27582025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
27592025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
27602025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27612025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27622025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
27632025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
27642025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
27652025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27662025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
27672025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
27682025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
27692025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27702025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27712025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27722025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27732025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27742025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
27752025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27762025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27772025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
27782025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27792025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27802025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27812025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27822025-01-06T20:33:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27832025-01-06T20:33:04.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27842025-01-06T20:33:04.991ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1027, tv_nsec: 679400108 } })
27852025-01-06T20:33:04.991ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.869599ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27862025-01-06T20:33:04.991ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1027, tv_nsec: 679737447 } })
27872025-01-06T20:33:04.991ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
27882025-01-06T20:33:04.991ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
27892025-01-06T20:33:04.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27902025-01-06T20:33:04.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27912025-01-06T20:33:04.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27922025-01-06T20:33:04.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27932025-01-06T20:33:04.994ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27942025-01-06T20:33:04.994ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27952025-01-06T20:33:04.994ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27962025-01-06T20:33:04.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27972025-01-06T20:33:04.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27982025-01-06T20:33:04.995ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27992025-01-06T20:33:04.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28002025-01-06T20:33:04.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28012025-01-06T20:33:04.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
28022025-01-06T20:33:04.995ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28032025-01-06T20:33:04.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28042025-01-06T20:33:04.997ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28052025-01-06T20:33:04.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28062025-01-06T20:33:04.997ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28072025-01-06T20:33:04.999ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28082025-01-06T20:33:04.999ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28092025-01-06T20:33:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
28102025-01-06T20:33:05.000ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28112025-01-06T20:33:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28122025-01-06T20:33:05.002ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
28132025-01-06T20:33:05.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28142025-01-06T20:33:05.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28152025-01-06T20:33:05.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28162025-01-06T20:33:05.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28172025-01-06T20:33:05.003ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28182025-01-06T20:33:05.003ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28192025-01-06T20:33:05.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28202025-01-06T20:33:05.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28212025-01-06T20:33:05.007ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28222025-01-06T20:33:05.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28232025-01-06T20:33:05.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28242025-01-06T20:33:05.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28252025-01-06T20:33:05.020ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
28262025-01-06T20:33:05.020ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 30.078879ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
28272025-01-06T20:33:05.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
28282025-01-06T20:33:05.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28292025-01-06T20:33:05.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28302025-01-06T20:33:05.024ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28312025-01-06T20:33:05.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28322025-01-06T20:33:05.025ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28332025-01-06T20:33:05.025ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1027, tv_nsec: 713765803 } })
28342025-01-06T20:33:05.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28352025-01-06T20:33:05.025ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
28362025-01-06T20:33:05.035ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28372025-01-06T20:33:05.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28382025-01-06T20:33:05.038ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28392025-01-06T20:33:05.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28402025-01-06T20:33:05.052ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
28412025-01-06T20:33:05.053ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.333581ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
28422025-01-06T20:33:05.054ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28432025-01-06T20:33:05.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28442025-01-06T20:33:05.056ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28452025-01-06T20:33:05.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28462025-01-06T20:33:05.060ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.027267ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28472025-01-06T20:33:05.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28482025-01-06T20:33:05.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28492025-01-06T20:33:05.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.157059ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28502025-01-06T20:33:05.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 74.501898ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
28512025-01-06T20:33:05.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.614865ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
28522025-01-06T20:33:05.067ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28532025-01-06T20:33:05.067ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28542025-01-06T20:33:05.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28552025-01-06T20:33:05.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28562025-01-06T20:33:05.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28572025-01-06T20:33:05.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28582025-01-06T20:33:05.075ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28592025-01-06T20:33:05.075ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28602025-01-06T20:33:05.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28612025-01-06T20:33:05.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28622025-01-06T20:33:05.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.795443ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28632025-01-06T20:33:05.077ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28642025-01-06T20:33:05.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
28652025-01-06T20:33:05.080ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28662025-01-06T20:33:05.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28672025-01-06T20:33:05.083ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 93.476175ms iteration = 10 status = 0
28682025-01-06T20:33:05.095ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28692025-01-06T20:33:05.096ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28702025-01-06T20:33:05.096ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfeda30d-8ee0-47ab-80ed-151d3f888c47", "content-length": "26", "date": "Mon, 06 Jan 2025 20:33:05 GMT"} })
28712025-01-06T20:33:05.096ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28722025-01-06T20:33:05.098ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28732025-01-06T20:33:05.113ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28742025-01-06T20:33:05.113ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28752025-01-06T20:33:05.113ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.234255ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28762025-01-06T20:33:05.113ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 123.444191ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
28772025-01-06T20:33:05.119ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28782025-01-06T20:33:05.119ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28792025-01-06T20:33:05.119ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7079f8a2-c69a-441b-8e47-f9f35890378d", "content-length": "26", "date": "Mon, 06 Jan 2025 20:33:05 GMT"} })
28802025-01-06T20:33:05.120ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28812025-01-06T20:33:05.121ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28822025-01-06T20:33:05.144ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28832025-01-06T20:33:05.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28842025-01-06T20:33:05.147ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 157.130078ms iteration = 12 status = {"physical_disks_added":0}
28852025-01-06T20:33:05.210ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 221.690955ms iteration = 10 status = {}
28862025-01-06T20:33:05.249ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28872025-01-06T20:33:05.249ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4dbc9d45-a83c-49e0-9094-6cde68cdf5fe", "content-length": "1", "date": "Mon, 06 Jan 2025 20:33:04 GMT"} })
28882025-01-06T20:33:05.251ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28892025-01-06T20:33:05.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28902025-01-06T20:33:05.258ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
28912025-01-06T20:33:05.258ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28922025-01-06T20:33:05.258ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cb9c1e1-31b8-4e28-bdbf-e010767002b2", "content-length": "26", "date": "Mon, 06 Jan 2025 20:33:05 GMT"} })
28932025-01-06T20:33:05.258ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28942025-01-06T20:33:05.260ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
28952025-01-06T20:33:05.261ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28962025-01-06T20:33:05.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28972025-01-06T20:33:05.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8aa47a39-3f6a-4b10-a6ef-64b6462020b8 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
28982025-01-06T20:33:05.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8aa47a39-3f6a-4b10-a6ef-64b6462020b8 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
28992025-01-06T20:33:05.283ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
29002025-01-06T20:33:05.283ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29012025-01-06T20:33:05.283ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1e59bb4-0310-46cf-a0ec-5dadeae3d803", "content-length": "372", "date": "Mon, 06 Jan 2025 20:33:05 GMT"} })
29022025-01-06T20:33:05.283ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29032025-01-06T20:33:05.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29042025-01-06T20:33:05.285ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29052025-01-06T20:33:05.285ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 297.19518ms iteration = 10 status = null
29062025-01-06T20:33:05.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8aa47a39-3f6a-4b10-a6ef-64b6462020b8 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29072025-01-06T20:33:05.287ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29082025-01-06T20:33:05.287ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29092025-01-06T20:33:05.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29102025-01-06T20:33:05.289ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29112025-01-06T20:33:05.290ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29122025-01-06T20:33:05.290ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29132025-01-06T20:33:05.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29142025-01-06T20:33:05.328ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
29152025-01-06T20:33:05.328ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29162025-01-06T20:33:05.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29172025-01-06T20:33:05.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29182025-01-06T20:33:05.398ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
29192025-01-06T20:33:05.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29202025-01-06T20:33:05.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29212025-01-06T20:33:05.409ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29222025-01-06T20:33:05.409ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29232025-01-06T20:33:05.409ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f1a0d20-972f-4dc4-9405-d6aaf90cbda9", "content-length": "134", "date": "Mon, 06 Jan 2025 20:33:04 GMT"} })
29242025-01-06T20:33:05.409ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
29252025-01-06T20:33:05.409ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
29262025-01-06T20:33:05.410ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29272025-01-06T20:33:05.410ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29282025-01-06T20:33:05.410ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29292025-01-06T20:33:05.410ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29302025-01-06T20:33:05.410ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29312025-01-06T20:33:05.410ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29322025-01-06T20:33:05.410ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29332025-01-06T20:33:05.410ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29342025-01-06T20:33:05.410ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
29352025-01-06T20:33:05.410ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29362025-01-06T20:33:05.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29372025-01-06T20:33:05.412ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29382025-01-06T20:33:05.412ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "79fe5c67-53ca-40fc-adf7-56d42055a57e", "content-length": "2", "date": "Mon, 06 Jan 2025 20:33:04 GMT"} })
29392025-01-06T20:33:05.412ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29402025-01-06T20:33:05.412ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dc61f72-56ba-4055-85ab-e46e127fe416", "content-length": "52", "date": "Mon, 06 Jan 2025 20:33:04 GMT"} })
29412025-01-06T20:33:05.412ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
29422025-01-06T20:33:05.412ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29432025-01-06T20:33:05.436ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6987d9df-12b4-44ce-a3b7-6db1546446e7", "date": "Mon, 06 Jan 2025 20:33:05 GMT"} })
29442025-01-06T20:33:05.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29452025-01-06T20:33:05.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29462025-01-06T20:33:05.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29472025-01-06T20:33:05.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29482025-01-06T20:33:05.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29492025-01-06T20:33:05.442ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0f3692c-8286-4b1a-9da8-8f4d7452f82f", "content-length": "691", "date": "Mon, 06 Jan 2025 20:33:05 GMT"} })
29502025-01-06T20:33:05.442ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
29512025-01-06T20:33:05.442ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
29522025-01-06T20:33:05.442ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
29532025-01-06T20:33:05.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29542025-01-06T20:33:05.444ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 454.757499ms iteration = 10 status = {}
29552025-01-06T20:33:05.446ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
29562025-01-06T20:33:05.446ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29572025-01-06T20:33:05.446ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3ffd9586-a199-4149-95ff-783b7a6ba330", "date": "Mon, 06 Jan 2025 20:33:05 GMT"} })
29582025-01-06T20:33:05.448ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 458.627833ms iteration = 10 status = {}
29592025-01-06T20:33:05.543ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b9d6900c-df69-4b34-ad57-a75e66414ae5", "date": "Mon, 06 Jan 2025 20:33:05 GMT"} })
29602025-01-06T20:33:05.543ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
29612025-01-06T20:33:05.543ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29622025-01-06T20:33:05.547ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c17c1b6e-aaef-42b7-a0fa-4b0bfdf9e42d", "content-length": "682", "date": "Mon, 06 Jan 2025 20:33:05 GMT"} })
29632025-01-06T20:33:05.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29642025-01-06T20:33:05.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29652025-01-06T20:33:05.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29662025-01-06T20:33:05.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29672025-01-06T20:33:05.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29682025-01-06T20:33:05.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29692025-01-06T20:33:05.556ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29702025-01-06T20:33:05.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29712025-01-06T20:33:05.563ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 573.806799ms iteration = 10 status = {}
29722025-01-06T20:33:06.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a03f09ff-7cd5-4809-912c-10dc5a4113cc roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29732025-01-06T20:33:06.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a03f09ff-7cd5-4809-912c-10dc5a4113cc resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29742025-01-06T20:33:06.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a03f09ff-7cd5-4809-912c-10dc5a4113cc response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29752025-01-06T20:33:07.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f66f81e6-547b-4e63-b45e-59246cb46540 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29762025-01-06T20:33:07.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f66f81e6-547b-4e63-b45e-59246cb46540 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29772025-01-06T20:33:07.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f66f81e6-547b-4e63-b45e-59246cb46540 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29782025-01-06T20:33:07.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 530 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = cc19541e-37c7-49ab-abd7-570425267037 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
29792025-01-06T20:33:08.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 700d5eff-79ca-4257-ab45-354ac4fa01de roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29802025-01-06T20:33:08.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 700d5eff-79ca-4257-ab45-354ac4fa01de resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29812025-01-06T20:33:08.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 700d5eff-79ca-4257-ab45-354ac4fa01de response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29822025-01-06T20:33:09.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 617bbf38-9bd9-4d24-80ce-df36b9336691 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29832025-01-06T20:33:09.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 617bbf38-9bd9-4d24-80ce-df36b9336691 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29842025-01-06T20:33:09.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 617bbf38-9bd9-4d24-80ce-df36b9336691 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29852025-01-06T20:33:10.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5ecf1ba3-3412-4818-b9b2-48dfaac34c61 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29862025-01-06T20:33:10.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5ecf1ba3-3412-4818-b9b2-48dfaac34c61 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29872025-01-06T20:33:10.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5ecf1ba3-3412-4818-b9b2-48dfaac34c61 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29882025-01-06T20:33:11.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 17e3ed1b-4a92-4f0d-8d99-7ae411bd31c8 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29892025-01-06T20:33:11.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 17e3ed1b-4a92-4f0d-8d99-7ae411bd31c8 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29902025-01-06T20:33:11.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 17e3ed1b-4a92-4f0d-8d99-7ae411bd31c8 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29912025-01-06T20:33:12.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = aa151301-7e45-420c-ae7c-1a6068200fdf roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29922025-01-06T20:33:12.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = aa151301-7e45-420c-ae7c-1a6068200fdf resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29932025-01-06T20:33:12.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = aa151301-7e45-420c-ae7c-1a6068200fdf response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29942025-01-06T20:33:13.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 127483f5-4f17-48d8-bf0f-fb80adc14bbb roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29952025-01-06T20:33:13.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 127483f5-4f17-48d8-bf0f-fb80adc14bbb resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29962025-01-06T20:33:13.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 127483f5-4f17-48d8-bf0f-fb80adc14bbb response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29972025-01-06T20:33:14.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5d0ada72-fcc8-4d33-a66e-37a1f921bfa0 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29982025-01-06T20:33:14.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5d0ada72-fcc8-4d33-a66e-37a1f921bfa0 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
29992025-01-06T20:33:14.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5d0ada72-fcc8-4d33-a66e-37a1f921bfa0 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30002025-01-06T20:33:14.989ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
30012025-01-06T20:33:14.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30022025-01-06T20:33:14.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30032025-01-06T20:33:14.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
30042025-01-06T20:33:14.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30052025-01-06T20:33:14.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30062025-01-06T20:33:14.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30072025-01-06T20:33:14.991ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30082025-01-06T20:33:14.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30092025-01-06T20:33:14.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30102025-01-06T20:33:14.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30112025-01-06T20:33:14.993ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.364889ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30122025-01-06T20:33:14.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30132025-01-06T20:33:14.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30142025-01-06T20:33:14.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30152025-01-06T20:33:14.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30162025-01-06T20:33:14.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
30172025-01-06T20:33:14.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30182025-01-06T20:33:14.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30192025-01-06T20:33:15.007ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
30202025-01-06T20:33:15.007ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.877944ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
30212025-01-06T20:33:15.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cc6a70e3-eccf-4441-8c37-e6084dd157a2 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30222025-01-06T20:33:15.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cc6a70e3-eccf-4441-8c37-e6084dd157a2 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30232025-01-06T20:33:15.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cc6a70e3-eccf-4441-8c37-e6084dd157a2 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30242025-01-06T20:33:16.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3daa4c7b-0e18-448a-9783-b16f58397763 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30252025-01-06T20:33:16.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3daa4c7b-0e18-448a-9783-b16f58397763 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30262025-01-06T20:33:16.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3daa4c7b-0e18-448a-9783-b16f58397763 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30272025-01-06T20:33:17.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7c003710-a563-4e50-ada3-fe8d61746ffe roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30282025-01-06T20:33:17.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7c003710-a563-4e50-ada3-fe8d61746ffe resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30292025-01-06T20:33:17.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7c003710-a563-4e50-ada3-fe8d61746ffe response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30302025-01-06T20:33:17.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = da60c8b1-c6f1-417c-a291-4f838813a3be roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
30312025-01-06T20:33:17.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = da60c8b1-c6f1-417c-a291-4f838813a3be resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
30322025-01-06T20:33:17.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2574 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = da60c8b1-c6f1-417c-a291-4f838813a3be response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
30332025-01-06T20:33:17.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 0680a526-36cc-4c05-a4ad-dd717eb77c4c roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
30342025-01-06T20:33:17.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 0680a526-36cc-4c05-a4ad-dd717eb77c4c resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
30352025-01-06T20:33:17.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 0680a526-36cc-4c05-a4ad-dd717eb77c4c response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
30362025-01-06T20:33:17.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 568 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 73e533a4-a487-4511-a999-7562821f1a59 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
30372025-01-06T20:33:18.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8c9a5fef-508e-46ca-a2ad-76217751596b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30382025-01-06T20:33:18.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8c9a5fef-508e-46ca-a2ad-76217751596b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30392025-01-06T20:33:18.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8c9a5fef-508e-46ca-a2ad-76217751596b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30402025-01-06T20:33:19.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8ceffef0-0745-4e98-ad25-e1a18b067aed roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30412025-01-06T20:33:19.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8ceffef0-0745-4e98-ad25-e1a18b067aed resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30422025-01-06T20:33:19.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8ceffef0-0745-4e98-ad25-e1a18b067aed response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30432025-01-06T20:33:20.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0445d9f9-5689-4198-aeb9-4f7f2a76f688 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30442025-01-06T20:33:20.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0445d9f9-5689-4198-aeb9-4f7f2a76f688 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30452025-01-06T20:33:20.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2737 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0445d9f9-5689-4198-aeb9-4f7f2a76f688 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30462025-01-06T20:33:21.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b5ba5418-bb80-442b-bce1-de0d49440eeb roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30472025-01-06T20:33:21.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b5ba5418-bb80-442b-bce1-de0d49440eeb resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30482025-01-06T20:33:21.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b5ba5418-bb80-442b-bce1-de0d49440eeb response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30492025-01-06T20:33:22.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 332cb416-17ef-4a1b-9dd9-dc37be7cbdac roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30502025-01-06T20:33:22.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 332cb416-17ef-4a1b-9dd9-dc37be7cbdac resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30512025-01-06T20:33:22.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1768 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 332cb416-17ef-4a1b-9dd9-dc37be7cbdac response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30522025-01-06T20:33:23.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 74b932d4-97fb-45cf-92a2-b76f8650ca50 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30532025-01-06T20:33:23.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 74b932d4-97fb-45cf-92a2-b76f8650ca50 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30542025-01-06T20:33:23.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 74b932d4-97fb-45cf-92a2-b76f8650ca50 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30552025-01-06T20:33:24.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 222000bb-5e7d-4bfa-b6b1-e69d90184621 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30562025-01-06T20:33:24.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 222000bb-5e7d-4bfa-b6b1-e69d90184621 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30572025-01-06T20:33:24.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 222000bb-5e7d-4bfa-b6b1-e69d90184621 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30582025-01-06T20:33:24.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
30592025-01-06T20:33:24.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30602025-01-06T20:33:24.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30612025-01-06T20:33:24.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
30622025-01-06T20:33:24.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30632025-01-06T20:33:24.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30642025-01-06T20:33:24.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30652025-01-06T20:33:24.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30662025-01-06T20:33:24.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30672025-01-06T20:33:24.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30682025-01-06T20:33:24.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30692025-01-06T20:33:24.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30702025-01-06T20:33:24.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30712025-01-06T20:33:24.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
30722025-01-06T20:33:24.998ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30732025-01-06T20:33:24.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30742025-01-06T20:33:25.012ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
30752025-01-06T20:33:25.012ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.220799ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
30762025-01-06T20:33:25.019ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30772025-01-06T20:33:25.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30782025-01-06T20:33:25.047ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.331338ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30792025-01-06T20:33:25.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0fb84653-bd69-46c5-b1ef-ba77ef9d98d4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30802025-01-06T20:33:25.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0fb84653-bd69-46c5-b1ef-ba77ef9d98d4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30812025-01-06T20:33:25.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0fb84653-bd69-46c5-b1ef-ba77ef9d98d4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30822025-01-06T20:33:26.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 26112191-d73b-4de3-a3b2-83aa107c7aeb roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30832025-01-06T20:33:26.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 26112191-d73b-4de3-a3b2-83aa107c7aeb resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30842025-01-06T20:33:26.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1617 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 26112191-d73b-4de3-a3b2-83aa107c7aeb response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30852025-01-06T20:33:27.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 825 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 7dade55e-a422-4d23-90ed-dd45c89f0f2f response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
30862025-01-06T20:33:27.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 86edb6e4-d7d1-446f-9cda-953d4d0a1aad roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30872025-01-06T20:33:27.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 86edb6e4-d7d1-446f-9cda-953d4d0a1aad resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30882025-01-06T20:33:27.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2016 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 86edb6e4-d7d1-446f-9cda-953d4d0a1aad response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30892025-01-06T20:33:28.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e7d7a7de-d961-4302-903a-bc8e421ed030 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30902025-01-06T20:33:28.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e7d7a7de-d961-4302-903a-bc8e421ed030 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30912025-01-06T20:33:28.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e7d7a7de-d961-4302-903a-bc8e421ed030 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30922025-01-06T20:33:29.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9d0058db-af25-47b8-8248-5e328fe3decc roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30932025-01-06T20:33:29.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9d0058db-af25-47b8-8248-5e328fe3decc resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30942025-01-06T20:33:29.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9d0058db-af25-47b8-8248-5e328fe3decc response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30952025-01-06T20:33:30.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 09cf5527-5c81-43df-b1c5-f2652fd43019 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30962025-01-06T20:33:30.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 09cf5527-5c81-43df-b1c5-f2652fd43019 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30972025-01-06T20:33:30.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 09cf5527-5c81-43df-b1c5-f2652fd43019 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30982025-01-06T20:33:31.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 374095ed-7f9b-4e78-b74a-a686c4d00a33 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
30992025-01-06T20:33:31.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 374095ed-7f9b-4e78-b74a-a686c4d00a33 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
31002025-01-06T20:33:31.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 374095ed-7f9b-4e78-b74a-a686c4d00a33 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
31012025-01-06T20:33:32.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 009239e2-f1f4-42b8-b559-4df8bbcee309 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
31022025-01-06T20:33:32.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 009239e2-f1f4-42b8-b559-4df8bbcee309 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
31032025-01-06T20:33:32.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 009239e2-f1f4-42b8-b559-4df8bbcee309 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
31042025-01-06T20:33:33.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bd9e7efc-bf3a-4703-b7cf-f476b2a4eb3a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
31052025-01-06T20:33:33.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bd9e7efc-bf3a-4703-b7cf-f476b2a4eb3a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
31062025-01-06T20:33:33.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bd9e7efc-bf3a-4703-b7cf-f476b2a4eb3a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
31072025-01-06T20:33:34.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 126e3a93-21ae-455a-82de-8774b3069324 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
31082025-01-06T20:33:34.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 126e3a93-21ae-455a-82de-8774b3069324 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
31092025-01-06T20:33:34.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 126e3a93-21ae-455a-82de-8774b3069324 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
31102025-01-06T20:33:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
31112025-01-06T20:33:34.988ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
31122025-01-06T20:33:34.988ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-06 20:23:34.988707034 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
31132025-01-06T20:33:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
31142025-01-06T20:33:34.988ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
31152025-01-06T20:33:34.988ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
31162025-01-06T20:33:34.988ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
31172025-01-06T20:33:34.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31182025-01-06T20:33:34.988ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31192025-01-06T20:33:34.988ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
31202025-01-06T20:33:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
31212025-01-06T20:33:34.988ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
31222025-01-06T20:33:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
31232025-01-06T20:33:34.988ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
31242025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31252025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31262025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
31272025-01-06T20:33:34.989ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468
31282025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
31292025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.221\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468"}
31302025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
31312025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31322025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
31332025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
31342025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31352025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
31362025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31372025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
31382025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
31392025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
31402025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31412025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31422025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31432025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
31442025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31452025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31462025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
31472025-01-06T20:33:34.989ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
31482025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31492025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
31502025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
31512025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31522025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31532025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31542025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
31552025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
31562025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
31572025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
31582025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
31592025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
31602025-01-06T20:33:34.989ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31612025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
31622025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
31632025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31642025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31652025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
31662025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
31672025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
31682025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31692025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
31702025-01-06T20:33:34.989ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
31712025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31722025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
31732025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31742025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
31752025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31762025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
31772025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31782025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31792025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31802025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31812025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31822025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31832025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31842025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31852025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31862025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
31872025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
31882025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31892025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
31902025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31912025-01-06T20:33:34.989ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("88aaaee6-38b4-4a83-9c08-04f0ea18e003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8dd67555-06fb-4cef-b914-9650f0eeb68a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1057, tv_nsec: 678147864 } })
31922025-01-06T20:33:34.989ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65bacdd1-9837-48ad-941c-aec5e2d79006.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1057, tv_nsec: 678152774 } })
31932025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31942025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31952025-01-06T20:33:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
31962025-01-06T20:33:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31972025-01-06T20:33:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31982025-01-06T20:33:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31992025-01-06T20:33:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32002025-01-06T20:33:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32012025-01-06T20:33:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32022025-01-06T20:33:34.990ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
32032025-01-06T20:33:34.990ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.381947ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
32042025-01-06T20:33:34.990ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
32052025-01-06T20:33:34.990ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.513981ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
32062025-01-06T20:33:34.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32072025-01-06T20:33:34.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32082025-01-06T20:33:34.992ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1057, tv_nsec: 680708003 } })
32092025-01-06T20:33:34.992ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.814443ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
32102025-01-06T20:33:34.992ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
32112025-01-06T20:33:34.992ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-06 20:23:34.988707034 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
32122025-01-06T20:33:34.992ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.986169ms iteration = 6 status = {"expiration":"2025-01-06T20:23:34.988707034Z","pruned":[]}
32132025-01-06T20:33:34.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32142025-01-06T20:33:34.993ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1057, tv_nsec: 681705760 } })
32152025-01-06T20:33:34.993ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32162025-01-06T20:33:34.993ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
32172025-01-06T20:33:34.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32182025-01-06T20:33:34.993ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32192025-01-06T20:33:34.994ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32202025-01-06T20:33:34.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32212025-01-06T20:33:34.995ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32222025-01-06T20:33:34.995ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32232025-01-06T20:33:34.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32242025-01-06T20:33:34.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32252025-01-06T20:33:34.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32262025-01-06T20:33:34.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32272025-01-06T20:33:34.999ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.794543ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
32282025-01-06T20:33:35.005ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.330005ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
32292025-01-06T20:33:35.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32302025-01-06T20:33:35.006ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32312025-01-06T20:33:35.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
32322025-01-06T20:33:35.008ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32332025-01-06T20:33:35.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32342025-01-06T20:33:35.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32352025-01-06T20:33:35.009ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32362025-01-06T20:33:35.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32372025-01-06T20:33:35.011ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32382025-01-06T20:33:35.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32392025-01-06T20:33:35.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32402025-01-06T20:33:35.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32412025-01-06T20:33:35.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32422025-01-06T20:33:35.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32432025-01-06T20:33:35.023ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
32442025-01-06T20:33:35.023ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
32452025-01-06T20:33:35.023ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
32462025-01-06T20:33:35.023ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32472025-01-06T20:33:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32482025-01-06T20:33:35.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32492025-01-06T20:33:35.024ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32502025-01-06T20:33:35.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32512025-01-06T20:33:35.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32522025-01-06T20:33:35.028ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32532025-01-06T20:33:35.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32542025-01-06T20:33:35.040ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32552025-01-06T20:33:35.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32562025-01-06T20:33:35.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32572025-01-06T20:33:35.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32582025-01-06T20:33:35.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
32592025-01-06T20:33:35.045ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32602025-01-06T20:33:35.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32612025-01-06T20:33:35.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32622025-01-06T20:33:35.046ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32632025-01-06T20:33:35.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32642025-01-06T20:33:35.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32652025-01-06T20:33:35.049ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32662025-01-06T20:33:35.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32672025-01-06T20:33:35.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
32682025-01-06T20:33:35.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32692025-01-06T20:33:35.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32702025-01-06T20:33:35.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32712025-01-06T20:33:35.069ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
32722025-01-06T20:33:35.069ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
32732025-01-06T20:33:35.069ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 79.905845ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
32742025-01-06T20:33:35.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32752025-01-06T20:33:35.071ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32762025-01-06T20:33:35.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32772025-01-06T20:33:35.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32782025-01-06T20:33:35.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
32792025-01-06T20:33:35.073ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32802025-01-06T20:33:35.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32812025-01-06T20:33:35.074ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32822025-01-06T20:33:35.074ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
32832025-01-06T20:33:35.074ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32842025-01-06T20:33:35.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32852025-01-06T20:33:35.075ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32862025-01-06T20:33:35.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32872025-01-06T20:33:35.077ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32882025-01-06T20:33:35.079ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32892025-01-06T20:33:35.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32902025-01-06T20:33:35.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32912025-01-06T20:33:35.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32922025-01-06T20:33:35.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32932025-01-06T20:33:35.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 98.683846ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32942025-01-06T20:33:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32952025-01-06T20:33:35.088ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1057, tv_nsec: 777082957 } })
32962025-01-06T20:33:35.089ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
32972025-01-06T20:33:35.090ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32982025-01-06T20:33:35.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32992025-01-06T20:33:35.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33002025-01-06T20:33:35.092ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 103.288712ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
33012025-01-06T20:33:35.092ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33022025-01-06T20:33:35.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33032025-01-06T20:33:35.093ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 104.524865ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33042025-01-06T20:33:35.094ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33052025-01-06T20:33:35.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33062025-01-06T20:33:35.096ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33072025-01-06T20:33:35.096ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33082025-01-06T20:33:35.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33092025-01-06T20:33:35.098ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33102025-01-06T20:33:35.099ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33112025-01-06T20:33:35.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33122025-01-06T20:33:35.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33132025-01-06T20:33:35.100ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33142025-01-06T20:33:35.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33152025-01-06T20:33:35.101ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
33162025-01-06T20:33:35.101ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 112.77904ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
33172025-01-06T20:33:35.102ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
33182025-01-06T20:33:35.102ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
33192025-01-06T20:33:35.102ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 113.307504ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
33202025-01-06T20:33:35.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33212025-01-06T20:33:35.102ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33222025-01-06T20:33:35.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33232025-01-06T20:33:35.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33242025-01-06T20:33:35.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
33252025-01-06T20:33:35.104ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33262025-01-06T20:33:35.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33272025-01-06T20:33:35.106ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
33282025-01-06T20:33:35.106ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 116.78841ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
33292025-01-06T20:33:35.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33302025-01-06T20:33:35.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33312025-01-06T20:33:35.114ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33322025-01-06T20:33:35.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33332025-01-06T20:33:35.119ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33342025-01-06T20:33:35.120ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33352025-01-06T20:33:35.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33362025-01-06T20:33:35.123ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33372025-01-06T20:33:35.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
33382025-01-06T20:33:35.124ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33392025-01-06T20:33:35.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33402025-01-06T20:33:35.125ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33412025-01-06T20:33:35.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33422025-01-06T20:33:35.127ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
33432025-01-06T20:33:35.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
33442025-01-06T20:33:35.130ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33452025-01-06T20:33:35.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33462025-01-06T20:33:35.134ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33472025-01-06T20:33:35.137ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33482025-01-06T20:33:35.137ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33492025-01-06T20:33:35.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33502025-01-06T20:33:35.137ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 148.853303ms iteration = 11 status = 0
33512025-01-06T20:33:35.141ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33522025-01-06T20:33:35.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33532025-01-06T20:33:35.144ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33542025-01-06T20:33:35.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33552025-01-06T20:33:35.144ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33562025-01-06T20:33:35.144ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33572025-01-06T20:33:35.144ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33582025-01-06T20:33:35.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33592025-01-06T20:33:35.145ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33602025-01-06T20:33:35.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33612025-01-06T20:33:35.147ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
33622025-01-06T20:33:35.147ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 0 version = 2
33632025-01-06T20:33:35.147ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33642025-01-06T20:33:35.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33652025-01-06T20:33:35.148ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33662025-01-06T20:33:35.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33672025-01-06T20:33:35.149ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33682025-01-06T20:33:35.149ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33692025-01-06T20:33:35.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33702025-01-06T20:33:35.150ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33712025-01-06T20:33:35.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33722025-01-06T20:33:35.152ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 163.661845ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33732025-01-06T20:33:35.153ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33742025-01-06T20:33:35.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33752025-01-06T20:33:35.153ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33762025-01-06T20:33:35.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33772025-01-06T20:33:35.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33782025-01-06T20:33:35.154ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33792025-01-06T20:33:35.154ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33802025-01-06T20:33:35.154ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
33812025-01-06T20:33:35.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33822025-01-06T20:33:35.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33832025-01-06T20:33:35.155ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33842025-01-06T20:33:35.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33852025-01-06T20:33:35.157ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 1 version = 2
33862025-01-06T20:33:35.157ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
33872025-01-06T20:33:35.158ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 168.715603ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
33882025-01-06T20:33:35.158ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-06 20:28:37.181288 UTC dns_group = external generation = 2
33892025-01-06T20:33:35.158ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 169.189296ms iteration = 6 status = {"generation":2}
33902025-01-06T20:33:35.158ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33912025-01-06T20:33:35.160ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
33922025-01-06T20:33:35.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
33932025-01-06T20:33:35.163ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33942025-01-06T20:33:35.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33952025-01-06T20:33:35.173ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33962025-01-06T20:33:35.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33972025-01-06T20:33:35.174ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33982025-01-06T20:33:35.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33992025-01-06T20:33:35.176ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34002025-01-06T20:33:35.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34012025-01-06T20:33:35.178ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34022025-01-06T20:33:35.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34032025-01-06T20:33:35.182ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34042025-01-06T20:33:35.182ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34052025-01-06T20:33:35.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34062025-01-06T20:33:35.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34072025-01-06T20:33:35.185ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34082025-01-06T20:33:35.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34092025-01-06T20:33:35.192ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-06T20:28:32.843602Z, time_modified: 2025-01-06T20:28:32.843602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }) }
34102025-01-06T20:33:35.192ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 203.569071ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]}},"default_endpoint":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
34112025-01-06T20:33:35.201ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34122025-01-06T20:33:35.201ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
34132025-01-06T20:33:35.201ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 212.003162ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
34142025-01-06T20:33:35.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34152025-01-06T20:33:35.202ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
34162025-01-06T20:33:35.202ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34172025-01-06T20:33:35.202ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "17f55e90-ab43-410c-9973-5c0e86570d5b", "content-length": "26", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} })
34182025-01-06T20:33:35.202ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34192025-01-06T20:33:35.205ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34202025-01-06T20:33:35.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34212025-01-06T20:33:35.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34222025-01-06T20:33:35.207ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34232025-01-06T20:33:35.245ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34242025-01-06T20:33:35.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34252025-01-06T20:33:35.249ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34262025-01-06T20:33:35.252ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34272025-01-06T20:33:35.252ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34282025-01-06T20:33:35.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34292025-01-06T20:33:35.260ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
34302025-01-06T20:33:35.260ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
34312025-01-06T20:33:35.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34322025-01-06T20:33:35.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34332025-01-06T20:33:35.299ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
34342025-01-06T20:33:35.299ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34352025-01-06T20:33:35.299ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1f4f0d2-ccef-43df-a13f-fdcb0c7fcb76", "content-length": "26", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} })
34362025-01-06T20:33:35.299ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34372025-01-06T20:33:35.303ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34382025-01-06T20:33:35.318ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
34392025-01-06T20:33:35.318ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 329.187921ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
34402025-01-06T20:33:35.328ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
34412025-01-06T20:33:35.336ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
34422025-01-06T20:33:35.336ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34432025-01-06T20:33:35.336ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7d5fae8-6e3d-433d-a87d-082eaf40af83", "content-length": "26", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} })
34442025-01-06T20:33:35.336ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34452025-01-06T20:33:35.338ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
34462025-01-06T20:33:35.369ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 380.654971ms iteration = 13 status = {"physical_disks_added":0}
34472025-01-06T20:33:35.396ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
34482025-01-06T20:33:35.397ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
34492025-01-06T20:33:35.397ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ff19fbb-80c6-4bc0-afa0-2489393ea754", "content-length": "1", "date": "Mon, 06 Jan 2025 20:33:34 GMT"} })
34502025-01-06T20:33:35.397ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c275c55b-129a-47a7-a5af-53b07017d793", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34512025-01-06T20:33:35.397ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34522025-01-06T20:33:35.399ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
34532025-01-06T20:33:35.399ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34542025-01-06T20:33:35.399ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed5bedf1-f412-4057-8d55-8e011b4968da", "content-length": "372", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} })
34552025-01-06T20:33:35.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34562025-01-06T20:33:35.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34572025-01-06T20:33:35.400ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2b3e1c0e-deb9-494e-a20c-93ad641f9897", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34582025-01-06T20:33:35.400ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34592025-01-06T20:33:35.401ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34602025-01-06T20:33:35.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34612025-01-06T20:33:35.401ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34622025-01-06T20:33:35.401ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34632025-01-06T20:33:35.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34642025-01-06T20:33:35.402ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34652025-01-06T20:33:35.402ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 413.608839ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
34662025-01-06T20:33:35.402ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34672025-01-06T20:33:35.403ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 414.78533ms iteration = 11 status = null
34682025-01-06T20:33:35.403ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34692025-01-06T20:33:35.404ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34702025-01-06T20:33:35.404ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34712025-01-06T20:33:35.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34722025-01-06T20:33:35.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34732025-01-06T20:33:35.406ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34742025-01-06T20:33:35.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34752025-01-06T20:33:35.408ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
34762025-01-06T20:33:35.408ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34772025-01-06T20:33:35.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34782025-01-06T20:33:35.408ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
34792025-01-06T20:33:35.408ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
34802025-01-06T20:33:35.408ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-06 20:28:35.848690 UTC dns_group = internal generation = 1
34812025-01-06T20:33:35.408ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 420.054624ms iteration = 6 status = {"generation":1}
34822025-01-06T20:33:35.414ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34832025-01-06T20:33:35.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34842025-01-06T20:33:35.441ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 453.101414ms iteration = 11 status = {}
34852025-01-06T20:33:35.453ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34862025-01-06T20:33:35.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34872025-01-06T20:33:35.456ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34882025-01-06T20:33:35.458ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
34892025-01-06T20:33:35.458ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c41fa9c5-85ec-4263-b16f-9502cca30601", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34902025-01-06T20:33:35.458ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34912025-01-06T20:33:35.459ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
34922025-01-06T20:33:35.459ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
34932025-01-06T20:33:35.459ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b3694b7e-de4a-4d2d-ba17-273be78c4225", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} })
34942025-01-06T20:33:35.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34952025-01-06T20:33:35.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34962025-01-06T20:33:35.460ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
34972025-01-06T20:33:35.460ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34982025-01-06T20:33:35.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34992025-01-06T20:33:35.461ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2580200a-8b61-4cef-a127-439048648598", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35002025-01-06T20:33:35.461ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35012025-01-06T20:33:35.463ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0d89602f-4ab5-4680-8fa6-627122e09ae4", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35022025-01-06T20:33:35.463ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35032025-01-06T20:33:35.465ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35042025-01-06T20:33:35.465ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 476.702486ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
35052025-01-06T20:33:35.482ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35062025-01-06T20:33:35.482ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a17af876-330d-4f22-a903-0b043123b03f", "content-length": "691", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} })
35072025-01-06T20:33:35.482ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
35082025-01-06T20:33:35.482ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
35092025-01-06T20:33:35.482ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
35102025-01-06T20:33:35.483ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35112025-01-06T20:33:35.483ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 494.815098ms iteration = 11 status = {}
35122025-01-06T20:33:35.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35132025-01-06T20:33:35.487ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35142025-01-06T20:33:35.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35152025-01-06T20:33:35.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35162025-01-06T20:33:35.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35172025-01-06T20:33:35.489ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35182025-01-06T20:33:35.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35192025-01-06T20:33:35.490ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
35202025-01-06T20:33:35.490ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35212025-01-06T20:33:35.491ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35222025-01-06T20:33:35.491ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b46f7645-892f-49b7-b286-553fbbae3c7c", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} })
35232025-01-06T20:33:35.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35242025-01-06T20:33:35.493ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 504.114993ms iteration = 11 status = {}
35252025-01-06T20:33:35.494ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35262025-01-06T20:33:35.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35272025-01-06T20:33:35.496ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35282025-01-06T20:33:35.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35292025-01-06T20:33:35.498ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35302025-01-06T20:33:35.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35312025-01-06T20:33:35.500ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35322025-01-06T20:33:35.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35332025-01-06T20:33:35.502ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35342025-01-06T20:33:35.506ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
35352025-01-06T20:33:35.506ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35362025-01-06T20:33:35.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35372025-01-06T20:33:35.507ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35382025-01-06T20:33:35.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35392025-01-06T20:33:35.509ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35402025-01-06T20:33:35.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35412025-01-06T20:33:35.510ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35422025-01-06T20:33:35.514ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
35432025-01-06T20:33:35.514ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35442025-01-06T20:33:35.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35452025-01-06T20:33:35.520ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 3625f012-ee30-4f98-8a1c-0af1461ec06d, kind: Service { id: 65bacdd1-9837-48ad-941c-aec5e2d79006 }, name: Name("external-dns-65bacdd1-9837-48ad-941c-aec5e2d79006"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4d552cc4-f760-463a-93c5-d2e30889777f, kind: Service { id: 66b4065d-0a65-4141-b8ec-3ce1f64a2d26 }, name: Name("external-dns-66b4065d-0a65-4141-b8ec-3ce1f64a2d26"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 4ce43e52-5d4e-4cdd-8eba-6b27829f964c, kind: Service { id: d4581482-c7a8-479c-a435-cf6d95b38f96 }, name: Name("nexus-d4581482-c7a8-479c-a435-cf6d95b38f96"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c82b60b3-cc02-4317-b01d-b79f84d25164, kind: Service { id: 0c1fb8d0-bed9-4de5-b5ae-b31f8c26aa7d }, name: Name("nexus-0c1fb8d0-bed9-4de5-b5ae-b31f8c26aa7d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eaad9b4b-165e-4563-bc83-588f65e0ba5a, kind: Service { id: e1810985-bbbe-481f-905f-91725e2502e7 }, name: Name("nexus-e1810985-bbbe-481f-905f-91725e2502e7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
35462025-01-06T20:33:35.520ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35472025-01-06T20:33:35.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35482025-01-06T20:33:35.521ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35492025-01-06T20:33:35.523ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
35502025-01-06T20:33:35.523ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35512025-01-06T20:33:35.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35522025-01-06T20:33:35.525ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
35532025-01-06T20:33:35.525ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3625f012-ee30-4f98-8a1c-0af1461ec06d, kind: Service { id: 65bacdd1-9837-48ad-941c-aec5e2d79006 }, name: Name("external-dns-65bacdd1-9837-48ad-941c-aec5e2d79006"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4d552cc4-f760-463a-93c5-d2e30889777f, kind: Service { id: 66b4065d-0a65-4141-b8ec-3ce1f64a2d26 }, name: Name("external-dns-66b4065d-0a65-4141-b8ec-3ce1f64a2d26"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4ce43e52-5d4e-4cdd-8eba-6b27829f964c, kind: Service { id: d4581482-c7a8-479c-a435-cf6d95b38f96 }, name: Name("nexus-d4581482-c7a8-479c-a435-cf6d95b38f96"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c82b60b3-cc02-4317-b01d-b79f84d25164, kind: Service { id: 0c1fb8d0-bed9-4de5-b5ae-b31f8c26aa7d }, name: Name("nexus-0c1fb8d0-bed9-4de5-b5ae-b31f8c26aa7d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eaad9b4b-165e-4563-bc83-588f65e0ba5a, kind: Service { id: e1810985-bbbe-481f-905f-91725e2502e7 }, name: Name("nexus-e1810985-bbbe-481f-905f-91725e2502e7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
35542025-01-06T20:33:35.525ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
35552025-01-06T20:33:35.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35562025-01-06T20:33:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35572025-01-06T20:33:35.532ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
35582025-01-06T20:33:35.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35592025-01-06T20:33:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35602025-01-06T20:33:35.539ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35612025-01-06T20:33:35.539ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe771694-7c25-4405-81fb-36064402c883", "content-length": "134", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} })
35622025-01-06T20:33:35.539ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
35632025-01-06T20:33:35.539ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
35642025-01-06T20:33:35.539ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
35652025-01-06T20:33:35.539ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35662025-01-06T20:33:35.539ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35672025-01-06T20:33:35.539ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35682025-01-06T20:33:35.539ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35692025-01-06T20:33:35.539ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35702025-01-06T20:33:35.539ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35712025-01-06T20:33:35.539ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35722025-01-06T20:33:35.540ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
35732025-01-06T20:33:35.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35742025-01-06T20:33:35.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35752025-01-06T20:33:35.542ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35762025-01-06T20:33:35.542ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9355c42e-d0c9-4690-b74c-d9617a218d30", "content-length": "2", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} })
35772025-01-06T20:33:35.542ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35782025-01-06T20:33:35.542ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec3c1f75-0d01-4106-b678-111bfb73925d", "content-length": "52", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} })
35792025-01-06T20:33:35.542ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
35802025-01-06T20:33:35.542ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35812025-01-06T20:33:35.582ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 346c1d3f-8af0-46bf-8798-77d7bb811a90, time_created: 2025-01-06T20:28:34.961221Z, time_modified: 2025-01-06T20:28:34.961221Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
35822025-01-06T20:33:35.582ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
35832025-01-06T20:33:35.582ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35842025-01-06T20:33:35.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35852025-01-06T20:33:35.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35862025-01-06T20:33:35.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35872025-01-06T20:33:35.586ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35882025-01-06T20:33:35.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
35892025-01-06T20:33:35.626ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
35902025-01-06T20:33:35.655ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "04002961-2944-4d1e-b02e-5d80071734e3", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} })
35912025-01-06T20:33:35.655ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
35922025-01-06T20:33:35.655ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35932025-01-06T20:33:35.655ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "33647611-842a-4fcc-98b0-9f0902e8d27b", "content-length": "682", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} })
35942025-01-06T20:33:35.656ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35952025-01-06T20:33:35.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35962025-01-06T20:33:35.661ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "f4f10340-cdf8-47fb-9e05-ccf7e8a6c4bd", "date": "Mon, 06 Jan 2025 20:33:35 GMT"} })
35972025-01-06T20:33:35.661ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35982025-01-06T20:33:35.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35992025-01-06T20:33:35.663ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
36002025-01-06T20:33:35.663ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 673.876114ms
36012025-01-06T20:33:35.663ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 673.889394ms iteration = 2 status = {}
36022025-01-06T20:33:35.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36032025-01-06T20:33:35.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36042025-01-06T20:33:35.668ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36052025-01-06T20:33:35.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36062025-01-06T20:33:35.675ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 686.525407ms iteration = 11 status = {}
36072025-01-06T20:33:35.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 79a186e1-3af9-499a-bd43-e92f45b43be6 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36082025-01-06T20:33:35.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 79a186e1-3af9-499a-bd43-e92f45b43be6 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36092025-01-06T20:33:35.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 79a186e1-3af9-499a-bd43-e92f45b43be6 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36102025-01-06T20:33:36.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 08926426-9327-44b2-9c5b-e56721620981 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36112025-01-06T20:33:36.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 08926426-9327-44b2-9c5b-e56721620981 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36122025-01-06T20:33:36.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 08926426-9327-44b2-9c5b-e56721620981 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36132025-01-06T20:33:37.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 465 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 437f68a6-00f2-42b6-b443-8c600d43016a response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
36142025-01-06T20:33:37.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bc1a1dc8-e64d-4167-8639-e1f744cd9a96 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36152025-01-06T20:33:37.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bc1a1dc8-e64d-4167-8639-e1f744cd9a96 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36162025-01-06T20:33:37.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bc1a1dc8-e64d-4167-8639-e1f744cd9a96 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36172025-01-06T20:33:39.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d72e8238-6cac-4833-aadd-723934e405f9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36182025-01-06T20:33:39.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d72e8238-6cac-4833-aadd-723934e405f9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36192025-01-06T20:33:39.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d72e8238-6cac-4833-aadd-723934e405f9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36202025-01-06T20:33:40.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 59b20d70-43c2-4926-9e51-36b14fc3662c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36212025-01-06T20:33:40.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 59b20d70-43c2-4926-9e51-36b14fc3662c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36222025-01-06T20:33:40.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2853 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 59b20d70-43c2-4926-9e51-36b14fc3662c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36232025-01-06T20:33:41.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5302ec58-40fc-4c97-b706-ececaad5401e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36242025-01-06T20:33:41.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5302ec58-40fc-4c97-b706-ececaad5401e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36252025-01-06T20:33:41.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5302ec58-40fc-4c97-b706-ececaad5401e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36262025-01-06T20:33:42.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 52b52a51-47db-4bab-94a0-c0d3d882eaa3 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36272025-01-06T20:33:42.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 52b52a51-47db-4bab-94a0-c0d3d882eaa3 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36282025-01-06T20:33:42.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 52b52a51-47db-4bab-94a0-c0d3d882eaa3 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36292025-01-06T20:33:43.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 02a413ff-969b-48cf-9383-481b05c5d856 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36302025-01-06T20:33:43.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 02a413ff-969b-48cf-9383-481b05c5d856 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36312025-01-06T20:33:43.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 02a413ff-969b-48cf-9383-481b05c5d856 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36322025-01-06T20:33:44.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f99cb09a-d80d-43b9-9ae5-3925116b1a93 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36332025-01-06T20:33:44.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f99cb09a-d80d-43b9-9ae5-3925116b1a93 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36342025-01-06T20:33:44.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f99cb09a-d80d-43b9-9ae5-3925116b1a93 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36352025-01-06T20:33:44.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
36362025-01-06T20:33:44.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36372025-01-06T20:33:44.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36382025-01-06T20:33:44.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
36392025-01-06T20:33:44.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36402025-01-06T20:33:44.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36412025-01-06T20:33:44.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36422025-01-06T20:33:44.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36432025-01-06T20:33:44.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36442025-01-06T20:33:44.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36452025-01-06T20:33:44.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36462025-01-06T20:33:44.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36472025-01-06T20:33:44.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36482025-01-06T20:33:44.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
36492025-01-06T20:33:44.998ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36502025-01-06T20:33:44.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36512025-01-06T20:33:45.008ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
36522025-01-06T20:33:45.008ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.390607ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
36532025-01-06T20:33:45.017ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36542025-01-06T20:33:45.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36552025-01-06T20:33:45.046ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.176257ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36562025-01-06T20:33:45.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 21dd0559-e664-43bc-9a85-3dc238ee300c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36572025-01-06T20:33:45.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 21dd0559-e664-43bc-9a85-3dc238ee300c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36582025-01-06T20:33:45.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1322 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 21dd0559-e664-43bc-9a85-3dc238ee300c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36592025-01-06T20:33:46.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e0cf4077-946a-479f-b1f8-71492419b529 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36602025-01-06T20:33:46.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e0cf4077-946a-479f-b1f8-71492419b529 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36612025-01-06T20:33:46.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e0cf4077-946a-479f-b1f8-71492419b529 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36622025-01-06T20:33:47.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 03498153-5b94-45b6-a1c4-6ec8d111d29b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36632025-01-06T20:33:47.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 03498153-5b94-45b6-a1c4-6ec8d111d29b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36642025-01-06T20:33:47.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 03498153-5b94-45b6-a1c4-6ec8d111d29b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36652025-01-06T20:33:47.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 528 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = f3c0783b-2ec1-4188-a2f9-37c384fb4c6f response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
36662025-01-06T20:33:48.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d79344c5-64bf-4990-8adc-4a16ab63fded roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36672025-01-06T20:33:48.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d79344c5-64bf-4990-8adc-4a16ab63fded resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36682025-01-06T20:33:48.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d79344c5-64bf-4990-8adc-4a16ab63fded response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36692025-01-06T20:33:49.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2406cdf4-4465-405d-bf14-3bfdbf290ef7 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36702025-01-06T20:33:49.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2406cdf4-4465-405d-bf14-3bfdbf290ef7 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36712025-01-06T20:33:49.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2406cdf4-4465-405d-bf14-3bfdbf290ef7 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36722025-01-06T20:33:50.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 27457491-ae37-4d8d-9a6a-18e8550a8da4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36732025-01-06T20:33:50.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 27457491-ae37-4d8d-9a6a-18e8550a8da4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36742025-01-06T20:33:50.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 27457491-ae37-4d8d-9a6a-18e8550a8da4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36752025-01-06T20:33:51.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8bee7e6e-40cd-4e23-b1ba-f47e2f5d2346 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36762025-01-06T20:33:51.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8bee7e6e-40cd-4e23-b1ba-f47e2f5d2346 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36772025-01-06T20:33:51.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8bee7e6e-40cd-4e23-b1ba-f47e2f5d2346 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36782025-01-06T20:33:52.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5bcfd4f4-6c4b-4696-96b5-c4c964c29069 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36792025-01-06T20:33:52.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5bcfd4f4-6c4b-4696-96b5-c4c964c29069 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36802025-01-06T20:33:52.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5bcfd4f4-6c4b-4696-96b5-c4c964c29069 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36812025-01-06T20:33:53.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 75ca903c-d2de-4115-bd3e-a832a39a5e1f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36822025-01-06T20:33:53.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 75ca903c-d2de-4115-bd3e-a832a39a5e1f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36832025-01-06T20:33:53.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 75ca903c-d2de-4115-bd3e-a832a39a5e1f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36842025-01-06T20:33:54.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 952e0ebc-43aa-4b22-be8a-22fe353715af roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36852025-01-06T20:33:54.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 952e0ebc-43aa-4b22-be8a-22fe353715af resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36862025-01-06T20:33:54.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 952e0ebc-43aa-4b22-be8a-22fe353715af response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
36872025-01-06T20:33:54.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
36882025-01-06T20:33:54.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36892025-01-06T20:33:54.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36902025-01-06T20:33:54.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
36912025-01-06T20:33:54.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36922025-01-06T20:33:54.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36932025-01-06T20:33:54.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36942025-01-06T20:33:54.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36952025-01-06T20:33:54.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36962025-01-06T20:33:54.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36972025-01-06T20:33:54.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36982025-01-06T20:33:54.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36992025-01-06T20:33:54.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37002025-01-06T20:33:54.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
37012025-01-06T20:33:54.998ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37022025-01-06T20:33:54.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37032025-01-06T20:33:55.010ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
37042025-01-06T20:33:55.010ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.095252ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
37052025-01-06T20:33:55.017ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37062025-01-06T20:33:55.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37072025-01-06T20:33:55.018ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.580055ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37082025-01-06T20:33:55.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f82fe525-8674-4e0f-aa91-bb8539b51788 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37092025-01-06T20:33:55.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f82fe525-8674-4e0f-aa91-bb8539b51788 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37102025-01-06T20:33:55.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1835 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f82fe525-8674-4e0f-aa91-bb8539b51788 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37112025-01-06T20:33:56.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0fe17dda-4940-4756-b681-cf0b30d46488 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37122025-01-06T20:33:56.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0fe17dda-4940-4756-b681-cf0b30d46488 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37132025-01-06T20:33:56.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0fe17dda-4940-4756-b681-cf0b30d46488 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37142025-01-06T20:33:57.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = aee0e07b-fffb-4953-bacb-fb33fd4a8401 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37152025-01-06T20:33:57.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = aee0e07b-fffb-4953-bacb-fb33fd4a8401 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37162025-01-06T20:33:57.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = aee0e07b-fffb-4953-bacb-fb33fd4a8401 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37172025-01-06T20:33:57.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 705 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 0ff99634-d2f1-4bd0-b7c5-951641ce6487 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
37182025-01-06T20:33:58.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e8b5ed97-7c9b-41b1-97e4-aefad49335de roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37192025-01-06T20:33:58.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e8b5ed97-7c9b-41b1-97e4-aefad49335de resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37202025-01-06T20:33:58.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e8b5ed97-7c9b-41b1-97e4-aefad49335de response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37212025-01-06T20:33:59.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ba040c49-9833-4bc7-8493-31756c457c6c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37222025-01-06T20:33:59.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ba040c49-9833-4bc7-8493-31756c457c6c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37232025-01-06T20:33:59.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1550 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ba040c49-9833-4bc7-8493-31756c457c6c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37242025-01-06T20:34:00.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0a567299-f8a6-4db9-b54c-6585edb3a485 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37252025-01-06T20:34:00.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0a567299-f8a6-4db9-b54c-6585edb3a485 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37262025-01-06T20:34:00.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0a567299-f8a6-4db9-b54c-6585edb3a485 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37272025-01-06T20:34:01.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 174d666f-bf53-47be-8469-3088617468e8 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37282025-01-06T20:34:01.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 174d666f-bf53-47be-8469-3088617468e8 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37292025-01-06T20:34:01.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 174d666f-bf53-47be-8469-3088617468e8 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37302025-01-06T20:34:02.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = da4b5087-b877-406b-b0b8-7f15d00aa356 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37312025-01-06T20:34:02.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = da4b5087-b877-406b-b0b8-7f15d00aa356 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37322025-01-06T20:34:02.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = da4b5087-b877-406b-b0b8-7f15d00aa356 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37332025-01-06T20:34:03.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 88e2c323-387f-4212-8f4b-7d6a69739a36 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37342025-01-06T20:34:03.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 88e2c323-387f-4212-8f4b-7d6a69739a36 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37352025-01-06T20:34:03.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 88e2c323-387f-4212-8f4b-7d6a69739a36 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37362025-01-06T20:34:04.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c5461901-a050-4227-ad79-3e37d1e028dd roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37372025-01-06T20:34:04.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c5461901-a050-4227-ad79-3e37d1e028dd resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37382025-01-06T20:34:04.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c5461901-a050-4227-ad79-3e37d1e028dd response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
37392025-01-06T20:34:04.988ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
37402025-01-06T20:34:04.988ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
37412025-01-06T20:34:04.988ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
37422025-01-06T20:34:04.988ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
37432025-01-06T20:34:04.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
37442025-01-06T20:34:04.988ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37452025-01-06T20:34:04.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37462025-01-06T20:34:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37472025-01-06T20:34:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37482025-01-06T20:34:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
37492025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
37502025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37512025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
37522025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
37532025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
37542025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
37552025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
37562025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
37572025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37582025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37592025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
37602025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37612025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
37622025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37632025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
37642025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
37652025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37662025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37672025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37682025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
37692025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37702025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
37712025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37722025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
37732025-01-06T20:34:04.989ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
37742025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37752025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
37762025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37772025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
37782025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37792025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
37802025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37812025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37822025-01-06T20:34:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37832025-01-06T20:34:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37842025-01-06T20:34:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37852025-01-06T20:34:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37862025-01-06T20:34:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37872025-01-06T20:34:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37882025-01-06T20:34:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37892025-01-06T20:34:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37902025-01-06T20:34:04.990ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1087, tv_nsec: 679237413 } })
37912025-01-06T20:34:04.990ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
37922025-01-06T20:34:04.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37932025-01-06T20:34:04.992ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.906106ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
37942025-01-06T20:34:04.992ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1087, tv_nsec: 680921579 } })
37952025-01-06T20:34:04.992ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
37962025-01-06T20:34:04.992ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.210027ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
37972025-01-06T20:34:04.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37982025-01-06T20:34:04.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37992025-01-06T20:34:04.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38002025-01-06T20:34:04.995ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38012025-01-06T20:34:04.996ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38022025-01-06T20:34:04.997ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38032025-01-06T20:34:04.997ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38042025-01-06T20:34:04.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38052025-01-06T20:34:04.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
38062025-01-06T20:34:04.997ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38072025-01-06T20:34:04.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38082025-01-06T20:34:04.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
38092025-01-06T20:34:04.999ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38102025-01-06T20:34:04.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38112025-01-06T20:34:04.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38122025-01-06T20:34:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
38132025-01-06T20:34:05.000ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38142025-01-06T20:34:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38152025-01-06T20:34:05.001ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38162025-01-06T20:34:05.001ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38172025-01-06T20:34:05.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38182025-01-06T20:34:05.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38192025-01-06T20:34:05.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38202025-01-06T20:34:05.007ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38212025-01-06T20:34:05.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38222025-01-06T20:34:05.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38232025-01-06T20:34:05.008ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1087, tv_nsec: 697171031 } })
38242025-01-06T20:34:05.008ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
38252025-01-06T20:34:05.009ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38262025-01-06T20:34:05.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38272025-01-06T20:34:05.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38282025-01-06T20:34:05.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38292025-01-06T20:34:05.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38302025-01-06T20:34:05.041ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.617055ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
38312025-01-06T20:34:05.041ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38322025-01-06T20:34:05.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38332025-01-06T20:34:05.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38342025-01-06T20:34:05.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38352025-01-06T20:34:05.046ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38362025-01-06T20:34:05.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38372025-01-06T20:34:05.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38382025-01-06T20:34:05.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38392025-01-06T20:34:05.047ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38402025-01-06T20:34:05.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38412025-01-06T20:34:05.051ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38422025-01-06T20:34:05.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38432025-01-06T20:34:05.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38442025-01-06T20:34:05.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38452025-01-06T20:34:05.052ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38462025-01-06T20:34:05.052ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
38472025-01-06T20:34:05.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38482025-01-06T20:34:05.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38492025-01-06T20:34:05.055ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38502025-01-06T20:34:05.055ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38512025-01-06T20:34:05.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38522025-01-06T20:34:05.057ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
38532025-01-06T20:34:05.057ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.679272ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
38542025-01-06T20:34:05.057ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.219567ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38552025-01-06T20:34:05.058ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38562025-01-06T20:34:05.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38572025-01-06T20:34:05.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
38582025-01-06T20:34:05.058ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38592025-01-06T20:34:05.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38602025-01-06T20:34:05.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 70.508459ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
38612025-01-06T20:34:05.060ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38622025-01-06T20:34:05.060ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
38632025-01-06T20:34:05.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38642025-01-06T20:34:05.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38652025-01-06T20:34:05.061ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 71.479055ms iteration = 12 status = 0
38662025-01-06T20:34:05.067ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
38672025-01-06T20:34:05.067ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38682025-01-06T20:34:05.067ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "df921384-8309-463c-a478-0081f864f1e0", "content-length": "26", "date": "Mon, 06 Jan 2025 20:34:05 GMT"} })
38692025-01-06T20:34:05.067ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38702025-01-06T20:34:05.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38712025-01-06T20:34:05.071ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38722025-01-06T20:34:05.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
38732025-01-06T20:34:05.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38742025-01-06T20:34:05.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38752025-01-06T20:34:05.076ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
38762025-01-06T20:34:05.076ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38772025-01-06T20:34:05.076ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38782025-01-06T20:34:05.076ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c655d62-75db-4faf-aa64-2341ef77cc02", "content-length": "26", "date": "Mon, 06 Jan 2025 20:34:05 GMT"} })
38792025-01-06T20:34:05.076ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38802025-01-06T20:34:05.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38812025-01-06T20:34:05.078ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38822025-01-06T20:34:05.093ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
38832025-01-06T20:34:05.093ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 105.197934ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
38842025-01-06T20:34:05.103ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 113.617353ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
38852025-01-06T20:34:05.109ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38862025-01-06T20:34:05.109ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38872025-01-06T20:34:05.109ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38882025-01-06T20:34:05.109ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 120.084939ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
38892025-01-06T20:34:05.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38902025-01-06T20:34:05.114ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
38912025-01-06T20:34:05.114ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38922025-01-06T20:34:05.114ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ce75cee-51bf-4861-b01e-1c1738d1dcf4", "content-length": "26", "date": "Mon, 06 Jan 2025 20:34:05 GMT"} })
38932025-01-06T20:34:05.114ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38942025-01-06T20:34:05.116ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 127.065979ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
38952025-01-06T20:34:05.116ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
38962025-01-06T20:34:05.163ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 175.423896ms iteration = 12 status = {}
38972025-01-06T20:34:05.166ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 176.890606ms iteration = 14 status = {"physical_disks_added":0}
38982025-01-06T20:34:05.166ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38992025-01-06T20:34:05.167ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fa933aa-3d1b-4d89-94bf-ede9735971b1", "content-length": "1", "date": "Mon, 06 Jan 2025 20:34:05 GMT"} })
39002025-01-06T20:34:05.169ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39012025-01-06T20:34:05.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39022025-01-06T20:34:05.174ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 186.149027ms iteration = 12 status = null
39032025-01-06T20:34:05.181ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
39042025-01-06T20:34:05.181ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39052025-01-06T20:34:05.182ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "073bafe1-53e3-440a-b4d1-3048e9477356", "content-length": "372", "date": "Mon, 06 Jan 2025 20:34:05 GMT"} })
39062025-01-06T20:34:05.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39072025-01-06T20:34:05.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39082025-01-06T20:34:05.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39092025-01-06T20:34:05.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39102025-01-06T20:34:05.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39112025-01-06T20:34:05.233ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39122025-01-06T20:34:05.233ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39132025-01-06T20:34:05.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39142025-01-06T20:34:05.235ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39152025-01-06T20:34:05.238ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39162025-01-06T20:34:05.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39172025-01-06T20:34:05.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39182025-01-06T20:34:05.247ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
39192025-01-06T20:34:05.247ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
39202025-01-06T20:34:05.247ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a0207b1f-657d-4f97-bd51-19ae21156dc6", "date": "Mon, 06 Jan 2025 20:34:05 GMT"} })
39212025-01-06T20:34:05.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39222025-01-06T20:34:05.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39232025-01-06T20:34:05.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39242025-01-06T20:34:05.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39252025-01-06T20:34:05.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39262025-01-06T20:34:05.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39272025-01-06T20:34:05.262ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
39282025-01-06T20:34:05.263ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39292025-01-06T20:34:05.263ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "130837a5-73f1-4415-9bea-0f40e61902b1", "date": "Mon, 06 Jan 2025 20:34:05 GMT"} })
39302025-01-06T20:34:05.264ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 275.18286ms iteration = 12 status = {}
39312025-01-06T20:34:05.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39322025-01-06T20:34:05.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39332025-01-06T20:34:05.284ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
39342025-01-06T20:34:05.284ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0cef11a-6647-475e-8edc-3bfbfdee4ee8", "content-length": "691", "date": "Mon, 06 Jan 2025 20:34:05 GMT"} })
39352025-01-06T20:34:05.284ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
39362025-01-06T20:34:05.284ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
39372025-01-06T20:34:05.284ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
39382025-01-06T20:34:05.285ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 296.125241ms iteration = 12 status = {}
39392025-01-06T20:34:05.286ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
39402025-01-06T20:34:05.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39412025-01-06T20:34:05.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39422025-01-06T20:34:05.306ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
39432025-01-06T20:34:05.306ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6f941f7-b96f-44a2-9892-d2ad3d09e06c", "content-length": "134", "date": "Mon, 06 Jan 2025 20:34:05 GMT"} })
39442025-01-06T20:34:05.306ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
39452025-01-06T20:34:05.306ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
39462025-01-06T20:34:05.306ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
39472025-01-06T20:34:05.306ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39482025-01-06T20:34:05.306ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39492025-01-06T20:34:05.306ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39502025-01-06T20:34:05.306ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39512025-01-06T20:34:05.306ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39522025-01-06T20:34:05.306ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39532025-01-06T20:34:05.306ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39542025-01-06T20:34:05.307ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
39552025-01-06T20:34:05.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39562025-01-06T20:34:05.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39572025-01-06T20:34:05.310ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
39582025-01-06T20:34:05.310ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d5727bd-fe30-4529-b68e-e954671c434d", "content-length": "2", "date": "Mon, 06 Jan 2025 20:34:05 GMT"} })
39592025-01-06T20:34:05.310ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
39602025-01-06T20:34:05.310ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "df272baa-86a9-4d09-a1b9-bfa20bbb128b", "content-length": "52", "date": "Mon, 06 Jan 2025 20:34:05 GMT"} })
39612025-01-06T20:34:05.310ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
39622025-01-06T20:34:05.310ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
39632025-01-06T20:34:05.412ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5c94f9f9-5371-4b67-b25f-12a6edcc0a53", "date": "Mon, 06 Jan 2025 20:34:05 GMT"} })
39642025-01-06T20:34:05.412ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
39652025-01-06T20:34:05.412ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
39662025-01-06T20:34:05.412ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b0dc33c-ef9d-4759-922f-f436224455ae", "content-length": "682", "date": "Mon, 06 Jan 2025 20:34:05 GMT"} })
39672025-01-06T20:34:05.412ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39682025-01-06T20:34:05.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39692025-01-06T20:34:05.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39702025-01-06T20:34:05.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39712025-01-06T20:34:05.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39722025-01-06T20:34:05.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39732025-01-06T20:34:05.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39742025-01-06T20:34:05.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39752025-01-06T20:34:05.427ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 437.663054ms iteration = 12 status = {}
39762025-01-06T20:34:05.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 72012081-a459-41a6-8542-f0be5e0e8bd2 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39772025-01-06T20:34:05.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 72012081-a459-41a6-8542-f0be5e0e8bd2 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39782025-01-06T20:34:05.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 72012081-a459-41a6-8542-f0be5e0e8bd2 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39792025-01-06T20:34:06.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 74d97efc-39ce-490f-bc82-0a39f22fac09 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39802025-01-06T20:34:06.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 74d97efc-39ce-490f-bc82-0a39f22fac09 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39812025-01-06T20:34:06.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 74d97efc-39ce-490f-bc82-0a39f22fac09 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39822025-01-06T20:34:07.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6efda223-c7f4-4f5d-baf4-2e7fc73af709 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39832025-01-06T20:34:07.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6efda223-c7f4-4f5d-baf4-2e7fc73af709 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39842025-01-06T20:34:07.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6efda223-c7f4-4f5d-baf4-2e7fc73af709 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39852025-01-06T20:34:07.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 559 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = b60691b5-9ad9-472c-9c27-c322692479e4 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
39862025-01-06T20:34:08.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2eb4a51d-7486-42ac-be8c-bf48e3341928 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39872025-01-06T20:34:08.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2eb4a51d-7486-42ac-be8c-bf48e3341928 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39882025-01-06T20:34:08.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2eb4a51d-7486-42ac-be8c-bf48e3341928 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39892025-01-06T20:34:09.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 11348745-6c82-4456-bdeb-f76516edf3ea roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39902025-01-06T20:34:09.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 11348745-6c82-4456-bdeb-f76516edf3ea resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39912025-01-06T20:34:09.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 11348745-6c82-4456-bdeb-f76516edf3ea response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39922025-01-06T20:34:10.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 14c20082-7b52-40b8-a7c9-dcb75f9da9e4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39932025-01-06T20:34:10.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 14c20082-7b52-40b8-a7c9-dcb75f9da9e4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39942025-01-06T20:34:10.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 14c20082-7b52-40b8-a7c9-dcb75f9da9e4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39952025-01-06T20:34:11.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0f18c210-09ce-4155-8c40-9cf2c9608362 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39962025-01-06T20:34:11.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0f18c210-09ce-4155-8c40-9cf2c9608362 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39972025-01-06T20:34:11.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0f18c210-09ce-4155-8c40-9cf2c9608362 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39982025-01-06T20:34:12.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9fc78049-5460-45fa-98b6-930ac2133a20 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
39992025-01-06T20:34:12.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9fc78049-5460-45fa-98b6-930ac2133a20 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40002025-01-06T20:34:12.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9fc78049-5460-45fa-98b6-930ac2133a20 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40012025-01-06T20:34:13.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 42a50117-194a-4c31-9fbd-fb4560ed7c15 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40022025-01-06T20:34:13.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 42a50117-194a-4c31-9fbd-fb4560ed7c15 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40032025-01-06T20:34:13.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 42a50117-194a-4c31-9fbd-fb4560ed7c15 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40042025-01-06T20:34:14.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 14b09999-4dc0-4eee-a2fb-1cbd2e117448 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40052025-01-06T20:34:14.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 14b09999-4dc0-4eee-a2fb-1cbd2e117448 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40062025-01-06T20:34:14.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 14b09999-4dc0-4eee-a2fb-1cbd2e117448 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40072025-01-06T20:34:14.987ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
40082025-01-06T20:34:14.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40092025-01-06T20:34:14.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40102025-01-06T20:34:14.988ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
40112025-01-06T20:34:14.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40122025-01-06T20:34:14.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40132025-01-06T20:34:14.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40142025-01-06T20:34:14.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40152025-01-06T20:34:14.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40162025-01-06T20:34:14.992ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.146525ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40172025-01-06T20:34:14.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40182025-01-06T20:34:14.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40192025-01-06T20:34:14.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40202025-01-06T20:34:14.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40212025-01-06T20:34:14.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40222025-01-06T20:34:14.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40232025-01-06T20:34:14.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
40242025-01-06T20:34:14.998ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40252025-01-06T20:34:14.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40262025-01-06T20:34:15.009ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
40272025-01-06T20:34:15.009ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.173197ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
40282025-01-06T20:34:15.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e679dc04-9ca4-4374-96fe-4f16d0aa43b8 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40292025-01-06T20:34:15.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e679dc04-9ca4-4374-96fe-4f16d0aa43b8 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40302025-01-06T20:34:15.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2915 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e679dc04-9ca4-4374-96fe-4f16d0aa43b8 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40312025-01-06T20:34:16.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9877c067-e452-42fc-9172-a36606178e96 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40322025-01-06T20:34:16.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9877c067-e452-42fc-9172-a36606178e96 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40332025-01-06T20:34:16.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9877c067-e452-42fc-9172-a36606178e96 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40342025-01-06T20:34:17.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = b13a753a-d2d0-4d00-8dea-5a7c6bafd055 roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
40352025-01-06T20:34:17.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = b13a753a-d2d0-4d00-8dea-5a7c6bafd055 resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
40362025-01-06T20:34:17.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2546 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = b13a753a-d2d0-4d00-8dea-5a7c6bafd055 response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
40372025-01-06T20:34:17.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = be95034b-fdae-4724-997b-949885f46660 roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
40382025-01-06T20:34:17.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = be95034b-fdae-4724-997b-949885f46660 resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
40392025-01-06T20:34:17.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = be95034b-fdae-4724-997b-949885f46660 response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
40402025-01-06T20:34:17.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 599 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 7aa835e9-6ec8-418a-9f74-43341ca80103 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
40412025-01-06T20:34:17.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a85eba3a-5e8c-4cf3-8e38-3188e5a22395 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40422025-01-06T20:34:17.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a85eba3a-5e8c-4cf3-8e38-3188e5a22395 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40432025-01-06T20:34:17.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1634 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a85eba3a-5e8c-4cf3-8e38-3188e5a22395 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40442025-01-06T20:34:18.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 38a319aa-110d-483c-8766-a0062b67c64d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40452025-01-06T20:34:18.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 38a319aa-110d-483c-8766-a0062b67c64d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40462025-01-06T20:34:18.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 38a319aa-110d-483c-8766-a0062b67c64d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40472025-01-06T20:34:19.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2398c4bc-c9ab-48de-8071-98edb1b7d7d4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40482025-01-06T20:34:19.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2398c4bc-c9ab-48de-8071-98edb1b7d7d4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40492025-01-06T20:34:19.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2398c4bc-c9ab-48de-8071-98edb1b7d7d4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40502025-01-06T20:34:20.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5a3d7449-9e77-4f76-9bbe-54ceca97a676 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40512025-01-06T20:34:20.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5a3d7449-9e77-4f76-9bbe-54ceca97a676 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40522025-01-06T20:34:20.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5a3d7449-9e77-4f76-9bbe-54ceca97a676 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40532025-01-06T20:34:21.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b21d7eb0-61aa-4de1-8940-2a1253fa22ef roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40542025-01-06T20:34:21.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b21d7eb0-61aa-4de1-8940-2a1253fa22ef resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40552025-01-06T20:34:21.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b21d7eb0-61aa-4de1-8940-2a1253fa22ef response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40562025-01-06T20:34:22.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ba46a6d3-76e0-4794-9b0c-16264dcad6b7 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40572025-01-06T20:34:22.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ba46a6d3-76e0-4794-9b0c-16264dcad6b7 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40582025-01-06T20:34:22.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ba46a6d3-76e0-4794-9b0c-16264dcad6b7 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40592025-01-06T20:34:23.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 036d7784-afdb-4c03-8b0c-2308824668e9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40602025-01-06T20:34:23.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 036d7784-afdb-4c03-8b0c-2308824668e9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40612025-01-06T20:34:23.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 036d7784-afdb-4c03-8b0c-2308824668e9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40622025-01-06T20:34:24.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 14804b72-5f73-43c5-b3bd-3922eee782cc roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40632025-01-06T20:34:24.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 14804b72-5f73-43c5-b3bd-3922eee782cc resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40642025-01-06T20:34:24.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 14804b72-5f73-43c5-b3bd-3922eee782cc response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40652025-01-06T20:34:24.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
40662025-01-06T20:34:24.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40672025-01-06T20:34:24.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40682025-01-06T20:34:24.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
40692025-01-06T20:34:24.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40702025-01-06T20:34:24.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40712025-01-06T20:34:24.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40722025-01-06T20:34:24.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40732025-01-06T20:34:24.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40742025-01-06T20:34:24.992ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.831457ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40752025-01-06T20:34:24.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40762025-01-06T20:34:24.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40772025-01-06T20:34:24.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40782025-01-06T20:34:24.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40792025-01-06T20:34:24.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40802025-01-06T20:34:24.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40812025-01-06T20:34:24.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
40822025-01-06T20:34:24.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40832025-01-06T20:34:24.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40842025-01-06T20:34:25.012ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
40852025-01-06T20:34:25.012ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.278511ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
40862025-01-06T20:34:26.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = abcb3db2-8436-440f-9851-bc56869d08b7 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40872025-01-06T20:34:26.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = abcb3db2-8436-440f-9851-bc56869d08b7 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40882025-01-06T20:34:26.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1813 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = abcb3db2-8436-440f-9851-bc56869d08b7 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40892025-01-06T20:34:27.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f1e9af49-9dd6-41b1-9e3d-81a78cac7848 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40902025-01-06T20:34:27.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f1e9af49-9dd6-41b1-9e3d-81a78cac7848 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40912025-01-06T20:34:27.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f1e9af49-9dd6-41b1-9e3d-81a78cac7848 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40922025-01-06T20:34:27.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 486 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = f8b3c812-d24a-479d-8f4c-3b54cf229752 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
40932025-01-06T20:34:28.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7c867ad2-0fb5-4dd2-b68f-5a7b667367ae roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40942025-01-06T20:34:28.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7c867ad2-0fb5-4dd2-b68f-5a7b667367ae resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40952025-01-06T20:34:28.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7c867ad2-0fb5-4dd2-b68f-5a7b667367ae response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40962025-01-06T20:34:29.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c2ecd2e8-fd9c-4d96-b5bd-8fef6f3062e5 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40972025-01-06T20:34:29.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c2ecd2e8-fd9c-4d96-b5bd-8fef6f3062e5 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40982025-01-06T20:34:29.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c2ecd2e8-fd9c-4d96-b5bd-8fef6f3062e5 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
40992025-01-06T20:34:30.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e4d102ef-43df-4b9d-b246-487d83fae347 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
41002025-01-06T20:34:30.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e4d102ef-43df-4b9d-b246-487d83fae347 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
41012025-01-06T20:34:30.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e4d102ef-43df-4b9d-b246-487d83fae347 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
41022025-01-06T20:34:31.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6a8dc40a-3bd3-45ac-bce2-041d12bcbab0 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
41032025-01-06T20:34:31.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6a8dc40a-3bd3-45ac-bce2-041d12bcbab0 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
41042025-01-06T20:34:31.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6a8dc40a-3bd3-45ac-bce2-041d12bcbab0 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
41052025-01-06T20:34:32.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c18c8c43-e35e-4761-a3b2-07d5fd986f77 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
41062025-01-06T20:34:32.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c18c8c43-e35e-4761-a3b2-07d5fd986f77 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
41072025-01-06T20:34:32.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c18c8c43-e35e-4761-a3b2-07d5fd986f77 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
41082025-01-06T20:34:33.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c5c01903-1d09-425b-b480-a7661c35fbf9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
41092025-01-06T20:34:33.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c5c01903-1d09-425b-b480-a7661c35fbf9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
41102025-01-06T20:34:33.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c5c01903-1d09-425b-b480-a7661c35fbf9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
41112025-01-06T20:34:34.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3f378df0-fd98-4d7a-b93b-828ec774373a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
41122025-01-06T20:34:34.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3f378df0-fd98-4d7a-b93b-828ec774373a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
41132025-01-06T20:34:34.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3f378df0-fd98-4d7a-b93b-828ec774373a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
41142025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
41152025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
41162025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
41172025-01-06T20:34:34.988ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-06 20:24:34.988118089 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
41182025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
41192025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
41202025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
41212025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41222025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
41232025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
41242025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
41252025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
41262025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41272025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
41282025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
41292025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
41302025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41312025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
41322025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41332025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
41342025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
41352025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41362025-01-06T20:34:34.988ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468
41372025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
41382025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.681\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468"}
41392025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41402025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
41412025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41422025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
41432025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
41442025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
41452025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
41462025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41472025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
41482025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
41492025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
41502025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41512025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41522025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
41532025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41542025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41552025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
41562025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41572025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41582025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
41592025-01-06T20:34:34.988ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
41602025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41612025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
41622025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
41632025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41642025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
41652025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41662025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41672025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
41682025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
41692025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
41702025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41712025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
41722025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
41732025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
41742025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41752025-01-06T20:34:34.989ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
41762025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41772025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41782025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
41792025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
41802025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41812025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
41822025-01-06T20:34:34.989ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
41832025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41842025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41852025-01-06T20:34:34.989ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("88aaaee6-38b4-4a83-9c08-04f0ea18e003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8dd67555-06fb-4cef-b914-9650f0eeb68a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1117, tv_nsec: 677834425 } })
41862025-01-06T20:34:34.989ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65bacdd1-9837-48ad-941c-aec5e2d79006.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1117, tv_nsec: 677843145 } })
41872025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41882025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41892025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41902025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41912025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
41922025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41932025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41942025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41952025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41962025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41972025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
41982025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41992025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42002025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42012025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42022025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42032025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42042025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42052025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42062025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
42072025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.379377ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
42082025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
42092025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.386208ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
42102025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42112025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42122025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42132025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42142025-01-06T20:34:34.989ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42152025-01-06T20:34:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42162025-01-06T20:34:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42172025-01-06T20:34:34.990ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42182025-01-06T20:34:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42192025-01-06T20:34:34.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42202025-01-06T20:34:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42212025-01-06T20:34:34.992ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1117, tv_nsec: 680918309 } })
42222025-01-06T20:34:34.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42232025-01-06T20:34:34.992ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
42242025-01-06T20:34:34.993ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1117, tv_nsec: 682193524 } })
42252025-01-06T20:34:34.993ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
42262025-01-06T20:34:34.993ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42272025-01-06T20:34:34.994ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-06 20:24:34.988118089 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
42282025-01-06T20:34:34.994ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.24765ms iteration = 7 status = {"expiration":"2025-01-06T20:24:34.988118089Z","pruned":[]}
42292025-01-06T20:34:34.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42302025-01-06T20:34:34.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42312025-01-06T20:34:34.995ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.142964ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
42322025-01-06T20:34:34.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42332025-01-06T20:34:34.995ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
42342025-01-06T20:34:34.995ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42352025-01-06T20:34:34.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42362025-01-06T20:34:34.997ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42372025-01-06T20:34:34.999ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.299231ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
42382025-01-06T20:34:34.999ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42392025-01-06T20:34:35.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
42402025-01-06T20:34:35.001ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42412025-01-06T20:34:35.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42422025-01-06T20:34:35.003ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
42432025-01-06T20:34:35.003ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42442025-01-06T20:34:35.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42452025-01-06T20:34:35.003ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.866774ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
42462025-01-06T20:34:35.004ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42472025-01-06T20:34:35.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42482025-01-06T20:34:35.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42492025-01-06T20:34:35.007ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
42502025-01-06T20:34:35.007ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
42512025-01-06T20:34:35.007ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 18.327649ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
42522025-01-06T20:34:35.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
42532025-01-06T20:34:35.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42542025-01-06T20:34:35.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42552025-01-06T20:34:35.009ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42562025-01-06T20:34:35.009ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42572025-01-06T20:34:35.010ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42582025-01-06T20:34:35.010ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42592025-01-06T20:34:35.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42602025-01-06T20:34:35.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
42612025-01-06T20:34:35.012ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42622025-01-06T20:34:35.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42632025-01-06T20:34:35.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42642025-01-06T20:34:35.013ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42652025-01-06T20:34:35.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42662025-01-06T20:34:35.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42672025-01-06T20:34:35.014ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42682025-01-06T20:34:35.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42692025-01-06T20:34:35.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42702025-01-06T20:34:35.016ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42712025-01-06T20:34:35.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42722025-01-06T20:34:35.019ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42732025-01-06T20:34:35.019ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42742025-01-06T20:34:35.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42752025-01-06T20:34:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42762025-01-06T20:34:35.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42772025-01-06T20:34:35.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42782025-01-06T20:34:35.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42792025-01-06T20:34:35.031ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
42802025-01-06T20:34:35.031ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
42812025-01-06T20:34:35.031ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
42822025-01-06T20:34:35.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42832025-01-06T20:34:35.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42842025-01-06T20:34:35.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 45.994872ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42852025-01-06T20:34:35.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42862025-01-06T20:34:35.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42872025-01-06T20:34:35.036ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1117, tv_nsec: 725626916 } })
42882025-01-06T20:34:35.037ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
42892025-01-06T20:34:35.037ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42902025-01-06T20:34:35.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42912025-01-06T20:34:35.040ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42922025-01-06T20:34:35.040ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 51.516373ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42932025-01-06T20:34:35.046ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42942025-01-06T20:34:35.046ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42952025-01-06T20:34:35.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42962025-01-06T20:34:35.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42972025-01-06T20:34:35.050ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42982025-01-06T20:34:35.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42992025-01-06T20:34:35.052ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43002025-01-06T20:34:35.053ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43012025-01-06T20:34:35.054ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43022025-01-06T20:34:35.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43032025-01-06T20:34:35.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43042025-01-06T20:34:35.056ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43052025-01-06T20:34:35.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43062025-01-06T20:34:35.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
43072025-01-06T20:34:35.057ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43082025-01-06T20:34:35.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43092025-01-06T20:34:35.060ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43102025-01-06T20:34:35.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43112025-01-06T20:34:35.061ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 72.991827ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
43122025-01-06T20:34:35.062ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43132025-01-06T20:34:35.062ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
43142025-01-06T20:34:35.062ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 0 version = 2
43152025-01-06T20:34:35.062ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43162025-01-06T20:34:35.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43172025-01-06T20:34:35.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43182025-01-06T20:34:35.065ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43192025-01-06T20:34:35.066ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43202025-01-06T20:34:35.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43212025-01-06T20:34:35.069ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43222025-01-06T20:34:35.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43232025-01-06T20:34:35.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43242025-01-06T20:34:35.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43252025-01-06T20:34:35.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43262025-01-06T20:34:35.072ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 1 version = 2
43272025-01-06T20:34:35.072ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
43282025-01-06T20:34:35.072ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-06 20:28:37.181288 UTC dns_group = external generation = 2
43292025-01-06T20:34:35.072ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 84.721877ms iteration = 7 status = {"generation":2}
43302025-01-06T20:34:35.074ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43312025-01-06T20:34:35.075ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43322025-01-06T20:34:35.075ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43332025-01-06T20:34:35.075ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43342025-01-06T20:34:35.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43352025-01-06T20:34:35.076ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43362025-01-06T20:34:35.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43372025-01-06T20:34:35.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43382025-01-06T20:34:35.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43392025-01-06T20:34:35.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43402025-01-06T20:34:35.079ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43412025-01-06T20:34:35.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43422025-01-06T20:34:35.079ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43432025-01-06T20:34:35.081ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43442025-01-06T20:34:35.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43452025-01-06T20:34:35.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43462025-01-06T20:34:35.082ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43472025-01-06T20:34:35.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43482025-01-06T20:34:35.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43492025-01-06T20:34:35.090ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43502025-01-06T20:34:35.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43512025-01-06T20:34:35.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43522025-01-06T20:34:35.095ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43532025-01-06T20:34:35.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43542025-01-06T20:34:35.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43552025-01-06T20:34:35.097ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43562025-01-06T20:34:35.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43572025-01-06T20:34:35.098ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
43582025-01-06T20:34:35.098ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
43592025-01-06T20:34:35.098ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
43602025-01-06T20:34:35.098ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43612025-01-06T20:34:35.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43622025-01-06T20:34:35.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43632025-01-06T20:34:35.100ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 111.668479ms iteration = 4 status = {"nsuccess":5}
43642025-01-06T20:34:35.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43652025-01-06T20:34:35.100ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43662025-01-06T20:34:35.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
43672025-01-06T20:34:35.101ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43682025-01-06T20:34:35.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43692025-01-06T20:34:35.101ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
43702025-01-06T20:34:35.101ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
43712025-01-06T20:34:35.101ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 113.1373ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
43722025-01-06T20:34:35.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43732025-01-06T20:34:35.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43742025-01-06T20:34:35.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43752025-01-06T20:34:35.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 131.526061ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43762025-01-06T20:34:35.121ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43772025-01-06T20:34:35.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43782025-01-06T20:34:35.122ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
43792025-01-06T20:34:35.123ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43802025-01-06T20:34:35.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43812025-01-06T20:34:35.129ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-06T20:28:32.843602Z, time_modified: 2025-01-06T20:28:32.843602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }) }
43822025-01-06T20:34:35.129ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 141.675587ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]}},"default_endpoint":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
43832025-01-06T20:34:35.130ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43842025-01-06T20:34:35.130ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43852025-01-06T20:34:35.130ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43862025-01-06T20:34:35.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43872025-01-06T20:34:35.131ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
43882025-01-06T20:34:35.131ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43892025-01-06T20:34:35.132ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb8a1309-8485-4860-bedb-fd952776101a", "content-length": "26", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} })
43902025-01-06T20:34:35.132ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43912025-01-06T20:34:35.133ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43922025-01-06T20:34:35.140ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 152.061629ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43932025-01-06T20:34:35.163ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
43942025-01-06T20:34:35.163ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43952025-01-06T20:34:35.164ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a86168d-ff2b-41bb-ab76-9bf0f75fc5e9", "content-length": "26", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} })
43962025-01-06T20:34:35.164ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43972025-01-06T20:34:35.165ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43982025-01-06T20:34:35.173ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43992025-01-06T20:34:35.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44002025-01-06T20:34:35.178ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
44012025-01-06T20:34:35.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e6e6e509-163e-4e21-a4c5-4c867f6b2430 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
44022025-01-06T20:34:35.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e6e6e509-163e-4e21-a4c5-4c867f6b2430 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
44032025-01-06T20:34:35.199ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 210.711216ms iteration = 15 status = {"physical_disks_added":0}
44042025-01-06T20:34:35.267ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
44052025-01-06T20:34:35.267ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44062025-01-06T20:34:35.268ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bbe424d-81bc-4344-a492-64635654d070", "content-length": "372", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} })
44072025-01-06T20:34:35.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44082025-01-06T20:34:35.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44092025-01-06T20:34:35.278ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44102025-01-06T20:34:35.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e6e6e509-163e-4e21-a4c5-4c867f6b2430 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
44112025-01-06T20:34:35.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44122025-01-06T20:34:35.289ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
44132025-01-06T20:34:35.289ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 300.987573ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
44142025-01-06T20:34:35.289ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
44152025-01-06T20:34:35.327ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44162025-01-06T20:34:35.327ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44172025-01-06T20:34:35.327ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 338.523165ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44182025-01-06T20:34:35.334ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 345.633569ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
44192025-01-06T20:34:35.336ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44202025-01-06T20:34:35.336ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44212025-01-06T20:34:35.338ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44222025-01-06T20:34:35.338ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44232025-01-06T20:34:35.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44242025-01-06T20:34:35.340ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
44252025-01-06T20:34:35.340ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
44262025-01-06T20:34:35.340ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44272025-01-06T20:34:35.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44282025-01-06T20:34:35.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
44292025-01-06T20:34:35.340ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44302025-01-06T20:34:35.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44312025-01-06T20:34:35.342ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44322025-01-06T20:34:35.342ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
44332025-01-06T20:34:35.342ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44342025-01-06T20:34:35.343ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "52d86bf2-58ff-48d2-81c8-f29493df9cb9", "content-length": "26", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} })
44352025-01-06T20:34:35.343ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44362025-01-06T20:34:35.343ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 354.337065ms iteration = 13 status = 0
44372025-01-06T20:34:35.344ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
44382025-01-06T20:34:35.346ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44392025-01-06T20:34:35.346ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44402025-01-06T20:34:35.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44412025-01-06T20:34:35.349ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
44422025-01-06T20:34:35.349ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
44432025-01-06T20:34:35.349ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-06 20:28:35.848690 UTC dns_group = internal generation = 1
44442025-01-06T20:34:35.349ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 361.524181ms iteration = 7 status = {"generation":1}
44452025-01-06T20:34:35.352ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
44462025-01-06T20:34:35.352ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
44472025-01-06T20:34:35.353ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f2c32bfb-c197-4a17-a0e0-ebf7a31426ae", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} })
44482025-01-06T20:34:35.353ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44492025-01-06T20:34:35.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44502025-01-06T20:34:35.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44512025-01-06T20:34:35.358ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
44522025-01-06T20:34:35.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44532025-01-06T20:34:35.359ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bb55e0b-ecbd-446e-aa46-092d56feb01b", "content-length": "1", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} })
44542025-01-06T20:34:35.361ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44552025-01-06T20:34:35.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44562025-01-06T20:34:35.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44572025-01-06T20:34:35.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44582025-01-06T20:34:35.363ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 375.428589ms iteration = 13 status = null
44592025-01-06T20:34:35.365ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
44602025-01-06T20:34:35.366ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44612025-01-06T20:34:35.366ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bbb158c2-050a-479b-aaff-5c07b3616d50", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} })
44622025-01-06T20:34:35.368ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 380.049625ms iteration = 13 status = {}
44632025-01-06T20:34:35.388ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44642025-01-06T20:34:35.390ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
44652025-01-06T20:34:35.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44662025-01-06T20:34:35.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44672025-01-06T20:34:35.391ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "798009d4-8ccb-4c6b-8a27-263bcc8f630e", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44682025-01-06T20:34:35.391ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44692025-01-06T20:34:35.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44702025-01-06T20:34:35.393ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4cabd505-60c1-48e1-b632-f377c51d56a4", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44712025-01-06T20:34:35.393ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44722025-01-06T20:34:35.394ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44732025-01-06T20:34:35.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 406.532566ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
44742025-01-06T20:34:35.403ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 415.391767ms iteration = 13 status = {}
44752025-01-06T20:34:35.422ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
44762025-01-06T20:34:35.423ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "2a6810fc-2c91-415a-a58d-28abf1ca1ab7", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44772025-01-06T20:34:35.423ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44782025-01-06T20:34:35.424ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3b737434-1f2b-4d16-8032-e4bf2b6d1912", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44792025-01-06T20:34:35.424ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44802025-01-06T20:34:35.425ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1979aadd-bcc0-404d-ae85-594ba3da7eb5", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44812025-01-06T20:34:35.425ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44822025-01-06T20:34:35.427ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
44832025-01-06T20:34:35.427ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 439.104272ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
44842025-01-06T20:34:35.427ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
44852025-01-06T20:34:35.427ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 438.68319ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
44862025-01-06T20:34:35.447ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44872025-01-06T20:34:35.447ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "29fdfd81-fc1d-4f99-ac7c-a61a4e2aa702", "content-length": "691", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} })
44882025-01-06T20:34:35.447ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
44892025-01-06T20:34:35.447ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
44902025-01-06T20:34:35.447ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
44912025-01-06T20:34:35.450ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 461.403049ms iteration = 13 status = {}
44922025-01-06T20:34:35.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44932025-01-06T20:34:35.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44942025-01-06T20:34:35.496ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
44952025-01-06T20:34:35.496ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44962025-01-06T20:34:35.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44972025-01-06T20:34:35.507ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44982025-01-06T20:34:35.508ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7002deb4-32e3-46a5-9e13-e16003ffd6e9", "content-length": "134", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} })
44992025-01-06T20:34:35.508ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
45002025-01-06T20:34:35.508ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
45012025-01-06T20:34:35.508ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
45022025-01-06T20:34:35.508ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45032025-01-06T20:34:35.508ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45042025-01-06T20:34:35.508ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45052025-01-06T20:34:35.508ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45062025-01-06T20:34:35.508ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45072025-01-06T20:34:35.508ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45082025-01-06T20:34:35.508ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45092025-01-06T20:34:35.508ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
45102025-01-06T20:34:35.508ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45112025-01-06T20:34:35.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45122025-01-06T20:34:35.511ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45132025-01-06T20:34:35.511ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e3ae8f0-d1b5-489a-ae50-b5f67028f970", "content-length": "2", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} })
45142025-01-06T20:34:35.511ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45152025-01-06T20:34:35.511ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "57d055b6-b8b8-4767-8d7a-f0392e20b7d1", "content-length": "52", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} })
45162025-01-06T20:34:35.511ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
45172025-01-06T20:34:35.511ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45182025-01-06T20:34:35.614ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
45192025-01-06T20:34:35.614ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
45202025-01-06T20:34:35.644ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
45212025-01-06T20:34:35.644ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:54156
45222025-01-06T20:34:35.645ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "21551447-af50-4a14-82e3-4cbe9f936c84", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} })
45232025-01-06T20:34:35.645ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
45242025-01-06T20:34:35.645ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45252025-01-06T20:34:35.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54156 req_id = 6243f4e8-0e43-4679-bac3-19507224ceaf roles = RoleSet { roles: {} } uri = /metrics/producers
45262025-01-06T20:34:35.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54156 req_id = 6243f4e8-0e43-4679-bac3-19507224ceaf resource = Database result = Ok(()) uri = /metrics/producers
45272025-01-06T20:34:35.679ZINFOnexus: assigned collector to new producer collector_id = 3aa155a2-91f9-44a1-9f26-4a40e0aef546 file = nexus/src/app/oximeter.rs:76 producer_id = d4581482-c7a8-479c-a435-cf6d95b38f96
45282025-01-06T20:34:35.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34165 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54156 req_id = 6243f4e8-0e43-4679-bac3-19507224ceaf response_code = 201 uri = /metrics/producers
45292025-01-06T20:34:35.679ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "6243f4e8-0e43-4679-bac3-19507224ceaf", "content-length": "41", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} })
45302025-01-06T20:34:35.680ZDEBGnexus (producer-registration-task): registered with nexus successfully
45312025-01-06T20:34:35.680ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
45322025-01-06T20:34:35.732ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "13dfc226-1787-41c9-9048-f4deec775a23", "content-length": "682", "date": "Mon, 06 Jan 2025 20:34:35 GMT"} })
45332025-01-06T20:34:35.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45342025-01-06T20:34:35.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45352025-01-06T20:34:35.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45362025-01-06T20:34:35.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45372025-01-06T20:34:35.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45382025-01-06T20:34:35.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45392025-01-06T20:34:35.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45402025-01-06T20:34:35.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45412025-01-06T20:34:35.751ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 762.520166ms iteration = 13 status = {}
45422025-01-06T20:34:36.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b5248ed8-bf1e-41a3-8682-40056919c0d4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45432025-01-06T20:34:36.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b5248ed8-bf1e-41a3-8682-40056919c0d4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45442025-01-06T20:34:36.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b5248ed8-bf1e-41a3-8682-40056919c0d4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45452025-01-06T20:34:37.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bc5d6792-b25a-4dfc-81ff-7b8081674eb1 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45462025-01-06T20:34:37.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bc5d6792-b25a-4dfc-81ff-7b8081674eb1 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45472025-01-06T20:34:37.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bc5d6792-b25a-4dfc-81ff-7b8081674eb1 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45482025-01-06T20:34:37.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 542 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 099a9360-f04f-4019-bf60-056ef3323f76 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
45492025-01-06T20:34:38.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 821e5d4c-afb1-4efa-8718-421433b59b0e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45502025-01-06T20:34:38.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 821e5d4c-afb1-4efa-8718-421433b59b0e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45512025-01-06T20:34:38.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2423 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 821e5d4c-afb1-4efa-8718-421433b59b0e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45522025-01-06T20:34:39.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 496a0cf1-2fd5-447c-b879-f066372284a6 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45532025-01-06T20:34:39.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 496a0cf1-2fd5-447c-b879-f066372284a6 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45542025-01-06T20:34:39.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 496a0cf1-2fd5-447c-b879-f066372284a6 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45552025-01-06T20:34:40.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ff0652b3-ba5d-4c0c-8bc7-dcf2d860cf76 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45562025-01-06T20:34:40.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ff0652b3-ba5d-4c0c-8bc7-dcf2d860cf76 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45572025-01-06T20:34:40.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ff0652b3-ba5d-4c0c-8bc7-dcf2d860cf76 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45582025-01-06T20:34:41.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9fcf3023-33d5-4a75-9b2b-0916d8378844 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45592025-01-06T20:34:41.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9fcf3023-33d5-4a75-9b2b-0916d8378844 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45602025-01-06T20:34:41.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9fcf3023-33d5-4a75-9b2b-0916d8378844 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45612025-01-06T20:34:42.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7dad63da-d18c-4507-b193-d9a152b014fd roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45622025-01-06T20:34:42.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7dad63da-d18c-4507-b193-d9a152b014fd resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45632025-01-06T20:34:42.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7dad63da-d18c-4507-b193-d9a152b014fd response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45642025-01-06T20:34:43.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9bdb110d-6f13-40f0-887b-0ce4c884587a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45652025-01-06T20:34:43.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9bdb110d-6f13-40f0-887b-0ce4c884587a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45662025-01-06T20:34:43.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2668 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9bdb110d-6f13-40f0-887b-0ce4c884587a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45672025-01-06T20:34:44.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c0b4eb21-83a5-4ebf-99bc-ef4dd9ecdfb3 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45682025-01-06T20:34:44.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c0b4eb21-83a5-4ebf-99bc-ef4dd9ecdfb3 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45692025-01-06T20:34:44.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c0b4eb21-83a5-4ebf-99bc-ef4dd9ecdfb3 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45702025-01-06T20:34:44.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
45712025-01-06T20:34:44.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45722025-01-06T20:34:44.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45732025-01-06T20:34:44.988ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
45742025-01-06T20:34:44.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45752025-01-06T20:34:44.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45762025-01-06T20:34:44.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45772025-01-06T20:34:44.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45782025-01-06T20:34:44.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45792025-01-06T20:34:44.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45802025-01-06T20:34:44.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45812025-01-06T20:34:44.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45822025-01-06T20:34:44.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45832025-01-06T20:34:44.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45842025-01-06T20:34:44.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45852025-01-06T20:34:44.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
45862025-01-06T20:34:44.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45872025-01-06T20:34:44.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45882025-01-06T20:34:45.010ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
45892025-01-06T20:34:45.010ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.518093ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
45902025-01-06T20:34:45.025ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.049129ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45912025-01-06T20:34:45.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7865e45b-bffd-479d-816b-b09277d8944b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45922025-01-06T20:34:45.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7865e45b-bffd-479d-816b-b09277d8944b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45932025-01-06T20:34:45.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7865e45b-bffd-479d-816b-b09277d8944b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45942025-01-06T20:34:46.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 28b239d6-33f4-478c-acfc-fdbea0827937 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45952025-01-06T20:34:46.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 28b239d6-33f4-478c-acfc-fdbea0827937 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45962025-01-06T20:34:46.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 28b239d6-33f4-478c-acfc-fdbea0827937 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45972025-01-06T20:34:47.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 43caf122-a6ec-4a67-b155-3dcdc58baac7 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45982025-01-06T20:34:47.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 43caf122-a6ec-4a67-b155-3dcdc58baac7 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
45992025-01-06T20:34:47.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 43caf122-a6ec-4a67-b155-3dcdc58baac7 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46002025-01-06T20:34:47.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 504 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = c63ad354-072d-484f-b5b5-43a97cdb85f0 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
46012025-01-06T20:34:48.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = de1501b9-69a1-497b-b46e-84e64489b43c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46022025-01-06T20:34:48.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = de1501b9-69a1-497b-b46e-84e64489b43c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46032025-01-06T20:34:48.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = de1501b9-69a1-497b-b46e-84e64489b43c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46042025-01-06T20:34:49.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 81282a84-5923-46f8-baf6-b302a4f86349 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46052025-01-06T20:34:49.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 81282a84-5923-46f8-baf6-b302a4f86349 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46062025-01-06T20:34:49.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 81282a84-5923-46f8-baf6-b302a4f86349 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46072025-01-06T20:34:50.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 40478f9f-6b0a-4368-8b5d-c4362fcfd55e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46082025-01-06T20:34:50.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 40478f9f-6b0a-4368-8b5d-c4362fcfd55e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46092025-01-06T20:34:50.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 40478f9f-6b0a-4368-8b5d-c4362fcfd55e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46102025-01-06T20:34:51.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cbe6e59e-685f-4e17-9185-dc852876bd26 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46112025-01-06T20:34:51.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cbe6e59e-685f-4e17-9185-dc852876bd26 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46122025-01-06T20:34:51.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cbe6e59e-685f-4e17-9185-dc852876bd26 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46132025-01-06T20:34:52.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a4c5e0be-66e1-4e6b-a950-dc944f4f82ea roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46142025-01-06T20:34:52.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a4c5e0be-66e1-4e6b-a950-dc944f4f82ea resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46152025-01-06T20:34:52.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a4c5e0be-66e1-4e6b-a950-dc944f4f82ea response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46162025-01-06T20:34:53.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ac569363-38ca-4cad-bba5-e08adbf11ff5 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46172025-01-06T20:34:53.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ac569363-38ca-4cad-bba5-e08adbf11ff5 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46182025-01-06T20:34:53.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ac569363-38ca-4cad-bba5-e08adbf11ff5 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46192025-01-06T20:34:54.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9b169a6c-216c-45b1-8959-d08df97f656c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46202025-01-06T20:34:54.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9b169a6c-216c-45b1-8959-d08df97f656c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46212025-01-06T20:34:54.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9b169a6c-216c-45b1-8959-d08df97f656c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46222025-01-06T20:34:54.987ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
46232025-01-06T20:34:54.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46242025-01-06T20:34:54.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46252025-01-06T20:34:54.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46262025-01-06T20:34:54.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
46272025-01-06T20:34:54.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46282025-01-06T20:34:54.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46292025-01-06T20:34:54.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46302025-01-06T20:34:54.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46312025-01-06T20:34:54.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46322025-01-06T20:34:54.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46332025-01-06T20:34:54.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46342025-01-06T20:34:54.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46352025-01-06T20:34:54.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46362025-01-06T20:34:54.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46372025-01-06T20:34:54.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
46382025-01-06T20:34:54.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46392025-01-06T20:34:54.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46402025-01-06T20:34:55.010ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
46412025-01-06T20:34:55.010ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.887103ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
46422025-01-06T20:34:55.025ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.557485ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46432025-01-06T20:34:55.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cc3d0890-bdfe-452e-a864-0ca93cf52b31 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46442025-01-06T20:34:55.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cc3d0890-bdfe-452e-a864-0ca93cf52b31 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46452025-01-06T20:34:55.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cc3d0890-bdfe-452e-a864-0ca93cf52b31 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46462025-01-06T20:34:56.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e305379e-92fb-4507-bba5-0d92baa7c1fb roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46472025-01-06T20:34:56.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e305379e-92fb-4507-bba5-0d92baa7c1fb resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46482025-01-06T20:34:56.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e305379e-92fb-4507-bba5-0d92baa7c1fb response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46492025-01-06T20:34:57.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 523 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = d329bc4e-f3fb-4ff6-9d55-bcd1e4ac63c3 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
46502025-01-06T20:34:57.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a044593e-6c80-4f95-9eaa-31cc59457e21 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46512025-01-06T20:34:57.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a044593e-6c80-4f95-9eaa-31cc59457e21 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46522025-01-06T20:34:57.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a044593e-6c80-4f95-9eaa-31cc59457e21 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46532025-01-06T20:34:58.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3a589bf0-3ab4-4f59-9ad4-30a6c19071e5 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46542025-01-06T20:34:58.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3a589bf0-3ab4-4f59-9ad4-30a6c19071e5 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46552025-01-06T20:34:58.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3a589bf0-3ab4-4f59-9ad4-30a6c19071e5 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46562025-01-06T20:34:59.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ffa8736d-7d4b-4668-b0c7-783d4620417a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46572025-01-06T20:34:59.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ffa8736d-7d4b-4668-b0c7-783d4620417a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46582025-01-06T20:34:59.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ffa8736d-7d4b-4668-b0c7-783d4620417a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46592025-01-06T20:35:00.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1b307861-c795-446b-8649-51dfa5995d32 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46602025-01-06T20:35:00.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1b307861-c795-446b-8649-51dfa5995d32 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46612025-01-06T20:35:00.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1b307861-c795-446b-8649-51dfa5995d32 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46622025-01-06T20:35:01.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 909cb251-e53f-4023-aee2-e9aa4924f5c0 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46632025-01-06T20:35:01.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 909cb251-e53f-4023-aee2-e9aa4924f5c0 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46642025-01-06T20:35:01.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 909cb251-e53f-4023-aee2-e9aa4924f5c0 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46652025-01-06T20:35:02.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1404b433-ca53-43c6-adc7-a347dc3ecf35 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46662025-01-06T20:35:02.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1404b433-ca53-43c6-adc7-a347dc3ecf35 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46672025-01-06T20:35:02.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1404b433-ca53-43c6-adc7-a347dc3ecf35 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46682025-01-06T20:35:03.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f757f96b-a654-46a8-a504-e0d536d73dfb roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46692025-01-06T20:35:03.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f757f96b-a654-46a8-a504-e0d536d73dfb resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46702025-01-06T20:35:03.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f757f96b-a654-46a8-a504-e0d536d73dfb response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46712025-01-06T20:35:04.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f2bab9d4-71de-4520-aa64-face7728f605 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46722025-01-06T20:35:04.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f2bab9d4-71de-4520-aa64-face7728f605 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46732025-01-06T20:35:04.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f2bab9d4-71de-4520-aa64-face7728f605 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
46742025-01-06T20:35:04.988ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
46752025-01-06T20:35:04.988ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46762025-01-06T20:35:04.988ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
46772025-01-06T20:35:04.988ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
46782025-01-06T20:35:04.988ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46792025-01-06T20:35:04.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
46802025-01-06T20:35:04.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46812025-01-06T20:35:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46822025-01-06T20:35:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46832025-01-06T20:35:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46842025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
46852025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
46862025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
46872025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46882025-01-06T20:35:04.989ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46892025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46902025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46912025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
46922025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46932025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
46942025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46952025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
46962025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46972025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
46982025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
46992025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
47002025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
47012025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
47022025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47032025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
47042025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
47052025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47062025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
47072025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47082025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
47092025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47102025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
47112025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47122025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47132025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47142025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47152025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47162025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47172025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47182025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47192025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
47202025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47212025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
47222025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47232025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47242025-01-06T20:35:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47252025-01-06T20:35:04.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47262025-01-06T20:35:04.991ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1147, tv_nsec: 680298682 } })
47272025-01-06T20:35:04.991ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
47282025-01-06T20:35:04.991ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47292025-01-06T20:35:04.991ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1147, tv_nsec: 680962280 } })
47302025-01-06T20:35:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47312025-01-06T20:35:04.991ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.860095ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
47322025-01-06T20:35:04.992ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47332025-01-06T20:35:04.992ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
47342025-01-06T20:35:04.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47352025-01-06T20:35:04.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47362025-01-06T20:35:04.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47372025-01-06T20:35:04.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47382025-01-06T20:35:04.994ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47392025-01-06T20:35:04.994ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47402025-01-06T20:35:04.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47412025-01-06T20:35:04.996ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47422025-01-06T20:35:04.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47432025-01-06T20:35:04.996ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47442025-01-06T20:35:04.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47452025-01-06T20:35:04.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47462025-01-06T20:35:04.998ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47472025-01-06T20:35:04.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47482025-01-06T20:35:05.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47492025-01-06T20:35:05.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47502025-01-06T20:35:05.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47512025-01-06T20:35:05.005ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47522025-01-06T20:35:05.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47532025-01-06T20:35:05.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47542025-01-06T20:35:05.010ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1147, tv_nsec: 699159975 } })
47552025-01-06T20:35:05.010ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
47562025-01-06T20:35:05.044ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47572025-01-06T20:35:05.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47582025-01-06T20:35:05.046ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47592025-01-06T20:35:05.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47602025-01-06T20:35:05.050ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.921378ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
47612025-01-06T20:35:05.053ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47622025-01-06T20:35:05.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47632025-01-06T20:35:05.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47642025-01-06T20:35:05.055ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 66.605724ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47652025-01-06T20:35:05.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47662025-01-06T20:35:05.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47672025-01-06T20:35:05.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47682025-01-06T20:35:05.059ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
47692025-01-06T20:35:05.059ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47702025-01-06T20:35:05.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.078488ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
47712025-01-06T20:35:05.059ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47722025-01-06T20:35:05.059ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a02bda6-d1ba-4a97-b732-abf962407b79", "content-length": "26", "date": "Mon, 06 Jan 2025 20:35:05 GMT"} })
47732025-01-06T20:35:05.059ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47742025-01-06T20:35:05.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47752025-01-06T20:35:05.059ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47762025-01-06T20:35:05.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47772025-01-06T20:35:05.061ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47782025-01-06T20:35:05.063ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47792025-01-06T20:35:05.063ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47802025-01-06T20:35:05.063ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47812025-01-06T20:35:05.063ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47822025-01-06T20:35:05.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47832025-01-06T20:35:05.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47842025-01-06T20:35:05.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47852025-01-06T20:35:05.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47862025-01-06T20:35:05.072ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.101592ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47872025-01-06T20:35:05.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47882025-01-06T20:35:05.077ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
47892025-01-06T20:35:05.077ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47902025-01-06T20:35:05.077ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cccf4fe4-e30c-4d7b-9d44-1e3235a6093b", "content-length": "26", "date": "Mon, 06 Jan 2025 20:35:05 GMT"} })
47912025-01-06T20:35:05.077ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47922025-01-06T20:35:05.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
47932025-01-06T20:35:05.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47942025-01-06T20:35:05.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47952025-01-06T20:35:05.078ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47962025-01-06T20:35:05.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47972025-01-06T20:35:05.078ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47982025-01-06T20:35:05.079ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47992025-01-06T20:35:05.079ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 90.235657ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
48002025-01-06T20:35:05.080ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48012025-01-06T20:35:05.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48022025-01-06T20:35:05.082ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48032025-01-06T20:35:05.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48042025-01-06T20:35:05.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 100.109355ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
48052025-01-06T20:35:05.096ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.90345ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
48062025-01-06T20:35:05.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48072025-01-06T20:35:05.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48082025-01-06T20:35:05.102ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
48092025-01-06T20:35:05.102ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 114.115476ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
48102025-01-06T20:35:05.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48112025-01-06T20:35:05.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48122025-01-06T20:35:05.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48132025-01-06T20:35:05.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
48142025-01-06T20:35:05.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48152025-01-06T20:35:05.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48162025-01-06T20:35:05.109ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 119.719249ms iteration = 14 status = 0
48172025-01-06T20:35:05.118ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48182025-01-06T20:35:05.118ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
48192025-01-06T20:35:05.118ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48202025-01-06T20:35:05.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48212025-01-06T20:35:05.118ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
48222025-01-06T20:35:05.118ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48232025-01-06T20:35:05.119ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7d97bd9-6a35-44ed-b924-cc5f6774a9db", "content-length": "26", "date": "Mon, 06 Jan 2025 20:35:05 GMT"} })
48242025-01-06T20:35:05.119ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48252025-01-06T20:35:05.120ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
48262025-01-06T20:35:05.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48272025-01-06T20:35:05.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48282025-01-06T20:35:05.151ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48292025-01-06T20:35:05.151ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
48302025-01-06T20:35:05.151ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 162.398911ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
48312025-01-06T20:35:05.193ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 204.324392ms iteration = 16 status = {"physical_disks_added":0}
48322025-01-06T20:35:05.273ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48332025-01-06T20:35:05.273ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8958e4bd-00b4-4655-9340-acc9016f4d4c", "content-length": "1", "date": "Mon, 06 Jan 2025 20:35:04 GMT"} })
48342025-01-06T20:35:05.275ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48352025-01-06T20:35:05.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48362025-01-06T20:35:05.290ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 302.331301ms iteration = 14 status = {}
48372025-01-06T20:35:05.321ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48382025-01-06T20:35:05.321ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48392025-01-06T20:35:05.321ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "94877572-5cc1-4886-b5e9-26ffde292358", "content-length": "372", "date": "Mon, 06 Jan 2025 20:35:05 GMT"} })
48402025-01-06T20:35:05.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48412025-01-06T20:35:05.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48422025-01-06T20:35:05.324ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 336.138ms iteration = 14 status = null
48432025-01-06T20:35:05.372ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
48442025-01-06T20:35:05.372ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
48452025-01-06T20:35:05.373ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b506a89e-ae77-47ee-b68f-ab95596123b6", "date": "Mon, 06 Jan 2025 20:35:05 GMT"} })
48462025-01-06T20:35:05.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48472025-01-06T20:35:05.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48482025-01-06T20:35:05.375ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48492025-01-06T20:35:05.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48502025-01-06T20:35:05.378ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48512025-01-06T20:35:05.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48522025-01-06T20:35:05.382ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48532025-01-06T20:35:05.382ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48542025-01-06T20:35:05.382ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a2d7fd3a-5188-4657-b958-9803b9c6274f", "date": "Mon, 06 Jan 2025 20:35:05 GMT"} })
48552025-01-06T20:35:05.382ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48562025-01-06T20:35:05.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48572025-01-06T20:35:05.383ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 394.659863ms iteration = 14 status = {}
48582025-01-06T20:35:05.385ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
48592025-01-06T20:35:05.385ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48602025-01-06T20:35:05.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48612025-01-06T20:35:05.396ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48622025-01-06T20:35:05.396ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7b422ad-0aff-42d9-afc1-f5853656e8fb", "content-length": "134", "date": "Mon, 06 Jan 2025 20:35:04 GMT"} })
48632025-01-06T20:35:05.396ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
48642025-01-06T20:35:05.396ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
48652025-01-06T20:35:05.396ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48662025-01-06T20:35:05.396ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48672025-01-06T20:35:05.396ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48682025-01-06T20:35:05.396ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48692025-01-06T20:35:05.396ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48702025-01-06T20:35:05.397ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48712025-01-06T20:35:05.397ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48722025-01-06T20:35:05.397ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48732025-01-06T20:35:05.397ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
48742025-01-06T20:35:05.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48752025-01-06T20:35:05.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48762025-01-06T20:35:05.399ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48772025-01-06T20:35:05.399ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4929c35b-284c-4de4-95f8-779eff30ed44", "content-length": "2", "date": "Mon, 06 Jan 2025 20:35:04 GMT"} })
48782025-01-06T20:35:05.399ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48792025-01-06T20:35:05.399ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f050f29-4de4-47ce-91b1-4f75f798628b", "content-length": "52", "date": "Mon, 06 Jan 2025 20:35:04 GMT"} })
48802025-01-06T20:35:05.399ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
48812025-01-06T20:35:05.399ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48822025-01-06T20:35:05.425ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48832025-01-06T20:35:05.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48842025-01-06T20:35:05.428ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48852025-01-06T20:35:05.429ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48862025-01-06T20:35:05.429ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48872025-01-06T20:35:05.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48882025-01-06T20:35:05.431ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48892025-01-06T20:35:05.433ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48902025-01-06T20:35:05.433ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48912025-01-06T20:35:05.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48922025-01-06T20:35:05.467ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
48932025-01-06T20:35:05.506ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9c98e0d3-ce0c-49cf-b4ea-c1183314c5c7", "date": "Mon, 06 Jan 2025 20:35:05 GMT"} })
48942025-01-06T20:35:05.506ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
48952025-01-06T20:35:05.506ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48962025-01-06T20:35:05.507ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ef7c6d4-8974-42f3-96e8-b7b4ddd869e9", "content-length": "682", "date": "Mon, 06 Jan 2025 20:35:05 GMT"} })
48972025-01-06T20:35:05.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48982025-01-06T20:35:05.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48992025-01-06T20:35:05.508ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d8b40b4-31f4-4eb6-829f-36ef44973a0b", "content-length": "691", "date": "Mon, 06 Jan 2025 20:35:05 GMT"} })
49002025-01-06T20:35:05.508ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
49012025-01-06T20:35:05.508ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
49022025-01-06T20:35:05.508ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
49032025-01-06T20:35:05.509ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 520.337854ms iteration = 14 status = {}
49042025-01-06T20:35:05.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49052025-01-06T20:35:05.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49062025-01-06T20:35:05.515ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49072025-01-06T20:35:05.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49082025-01-06T20:35:05.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49092025-01-06T20:35:05.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49102025-01-06T20:35:05.525ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 535.842936ms iteration = 14 status = {}
49112025-01-06T20:35:05.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7ec6cdc8-76d1-4840-9b18-8e52b1c87107 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49122025-01-06T20:35:05.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7ec6cdc8-76d1-4840-9b18-8e52b1c87107 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49132025-01-06T20:35:05.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7ec6cdc8-76d1-4840-9b18-8e52b1c87107 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49142025-01-06T20:35:06.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 319a72ca-b4fb-4e69-875c-b3a081f65049 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49152025-01-06T20:35:06.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 319a72ca-b4fb-4e69-875c-b3a081f65049 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49162025-01-06T20:35:06.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 319a72ca-b4fb-4e69-875c-b3a081f65049 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49172025-01-06T20:35:07.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 457 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 648da728-1934-4e92-9820-e1a1ed9ebc01 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
49182025-01-06T20:35:07.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f59f6b01-1d8b-4265-abeb-d0b631506eb2 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49192025-01-06T20:35:07.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f59f6b01-1d8b-4265-abeb-d0b631506eb2 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49202025-01-06T20:35:07.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1738 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f59f6b01-1d8b-4265-abeb-d0b631506eb2 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49212025-01-06T20:35:09.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 95bb003e-755c-4f9c-99f1-d461dd54ab5a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49222025-01-06T20:35:09.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 95bb003e-755c-4f9c-99f1-d461dd54ab5a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49232025-01-06T20:35:09.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 95bb003e-755c-4f9c-99f1-d461dd54ab5a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49242025-01-06T20:35:10.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b2f7ce76-9289-4e8a-8049-7f7624f3434e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49252025-01-06T20:35:10.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b2f7ce76-9289-4e8a-8049-7f7624f3434e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49262025-01-06T20:35:10.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2661 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b2f7ce76-9289-4e8a-8049-7f7624f3434e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49272025-01-06T20:35:11.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9a161779-4891-4b81-9403-c794aa5836ed roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49282025-01-06T20:35:11.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9a161779-4891-4b81-9403-c794aa5836ed resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49292025-01-06T20:35:11.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1962 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9a161779-4891-4b81-9403-c794aa5836ed response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49302025-01-06T20:35:12.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 240db58c-c054-472e-b7f0-440771bfd4b3 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49312025-01-06T20:35:12.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 240db58c-c054-472e-b7f0-440771bfd4b3 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49322025-01-06T20:35:12.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 240db58c-c054-472e-b7f0-440771bfd4b3 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49332025-01-06T20:35:13.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e16332fa-ee88-4fd2-93dc-c01cbf2a1103 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49342025-01-06T20:35:13.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e16332fa-ee88-4fd2-93dc-c01cbf2a1103 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49352025-01-06T20:35:13.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e16332fa-ee88-4fd2-93dc-c01cbf2a1103 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49362025-01-06T20:35:14.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1bb01885-592c-40ec-9b0d-3e895817a388 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49372025-01-06T20:35:14.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1bb01885-592c-40ec-9b0d-3e895817a388 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49382025-01-06T20:35:14.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1bb01885-592c-40ec-9b0d-3e895817a388 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49392025-01-06T20:35:14.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
49402025-01-06T20:35:14.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49412025-01-06T20:35:14.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49422025-01-06T20:35:14.988ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
49432025-01-06T20:35:14.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49442025-01-06T20:35:14.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49452025-01-06T20:35:14.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49462025-01-06T20:35:14.991ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49472025-01-06T20:35:14.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49482025-01-06T20:35:14.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49492025-01-06T20:35:14.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49502025-01-06T20:35:14.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49512025-01-06T20:35:14.993ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.640297ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49522025-01-06T20:35:14.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49532025-01-06T20:35:14.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49542025-01-06T20:35:14.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49552025-01-06T20:35:14.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
49562025-01-06T20:35:14.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49572025-01-06T20:35:14.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49582025-01-06T20:35:15.010ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
49592025-01-06T20:35:15.010ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.905933ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
49602025-01-06T20:35:15.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 194f058a-605c-471c-ae08-0357dacfdd0e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49612025-01-06T20:35:15.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 194f058a-605c-471c-ae08-0357dacfdd0e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49622025-01-06T20:35:15.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 194f058a-605c-471c-ae08-0357dacfdd0e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49632025-01-06T20:35:16.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 121e78f5-9308-408f-b2e8-360c0ff75476 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49642025-01-06T20:35:16.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 121e78f5-9308-408f-b2e8-360c0ff75476 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49652025-01-06T20:35:16.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 121e78f5-9308-408f-b2e8-360c0ff75476 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49662025-01-06T20:35:17.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5d9913a8-0144-4382-891d-81a45a0a3d82 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49672025-01-06T20:35:17.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5d9913a8-0144-4382-891d-81a45a0a3d82 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49682025-01-06T20:35:17.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5d9913a8-0144-4382-891d-81a45a0a3d82 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49692025-01-06T20:35:17.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 837 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 1fdee031-86c1-4e86-834f-3d547f75c144 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
49702025-01-06T20:35:18.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cabd9822-1e43-4db9-a941-2e9a01b3d33b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49712025-01-06T20:35:18.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cabd9822-1e43-4db9-a941-2e9a01b3d33b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49722025-01-06T20:35:18.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cabd9822-1e43-4db9-a941-2e9a01b3d33b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49732025-01-06T20:35:19.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c78251a4-26d5-4276-8d5d-dc106d75a415 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49742025-01-06T20:35:19.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c78251a4-26d5-4276-8d5d-dc106d75a415 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49752025-01-06T20:35:19.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c78251a4-26d5-4276-8d5d-dc106d75a415 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49762025-01-06T20:35:20.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b0a2631d-70a7-42d2-a8c4-74138b05e601 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49772025-01-06T20:35:20.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b0a2631d-70a7-42d2-a8c4-74138b05e601 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49782025-01-06T20:35:20.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b0a2631d-70a7-42d2-a8c4-74138b05e601 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49792025-01-06T20:35:21.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 65e8d3b4-6918-425f-be2f-031b4e58afad roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49802025-01-06T20:35:21.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 65e8d3b4-6918-425f-be2f-031b4e58afad resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49812025-01-06T20:35:21.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 65e8d3b4-6918-425f-be2f-031b4e58afad response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49822025-01-06T20:35:22.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = aded1948-6516-4385-96bb-460f46803f12 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49832025-01-06T20:35:22.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = aded1948-6516-4385-96bb-460f46803f12 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49842025-01-06T20:35:22.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = aded1948-6516-4385-96bb-460f46803f12 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49852025-01-06T20:35:23.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debb3ab-4612-4da4-85e7-c0ee7d8182af roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49862025-01-06T20:35:23.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debb3ab-4612-4da4-85e7-c0ee7d8182af resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49872025-01-06T20:35:23.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debb3ab-4612-4da4-85e7-c0ee7d8182af response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49882025-01-06T20:35:24.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a347bffa-54ff-4ef3-936b-eb233d42f8b2 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49892025-01-06T20:35:24.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a347bffa-54ff-4ef3-936b-eb233d42f8b2 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49902025-01-06T20:35:24.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a347bffa-54ff-4ef3-936b-eb233d42f8b2 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
49912025-01-06T20:35:24.988ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
49922025-01-06T20:35:24.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
49932025-01-06T20:35:24.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49942025-01-06T20:35:24.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49952025-01-06T20:35:24.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49962025-01-06T20:35:24.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49972025-01-06T20:35:24.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49982025-01-06T20:35:24.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49992025-01-06T20:35:24.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50002025-01-06T20:35:24.992ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.0415ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50012025-01-06T20:35:24.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50022025-01-06T20:35:24.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50032025-01-06T20:35:24.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50042025-01-06T20:35:24.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50052025-01-06T20:35:24.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50062025-01-06T20:35:24.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50072025-01-06T20:35:24.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
50082025-01-06T20:35:24.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50092025-01-06T20:35:24.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50102025-01-06T20:35:25.006ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
50112025-01-06T20:35:25.006ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.346749ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
50122025-01-06T20:35:25.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1bababb0-7de2-4bd9-8b3c-3c885c3d0540 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50132025-01-06T20:35:25.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1bababb0-7de2-4bd9-8b3c-3c885c3d0540 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50142025-01-06T20:35:25.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1bababb0-7de2-4bd9-8b3c-3c885c3d0540 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50152025-01-06T20:35:26.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3bf6c424-6f88-4402-b161-a69f5b55b3bc roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50162025-01-06T20:35:26.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3bf6c424-6f88-4402-b161-a69f5b55b3bc resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50172025-01-06T20:35:26.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1558 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3bf6c424-6f88-4402-b161-a69f5b55b3bc response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50182025-01-06T20:35:27.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 37d2c23a-afe1-4e8c-a135-26b8707ce12f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50192025-01-06T20:35:27.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 37d2c23a-afe1-4e8c-a135-26b8707ce12f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50202025-01-06T20:35:27.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 37d2c23a-afe1-4e8c-a135-26b8707ce12f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50212025-01-06T20:35:27.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 468 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 1616ff3a-0c10-4038-af71-1559bf8400ee response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
50222025-01-06T20:35:28.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 94455086-93ac-4e2c-973c-882d77c61229 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50232025-01-06T20:35:28.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 94455086-93ac-4e2c-973c-882d77c61229 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50242025-01-06T20:35:28.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 94455086-93ac-4e2c-973c-882d77c61229 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50252025-01-06T20:35:29.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 80a1d8f1-c57a-4a91-9585-f07109e8f969 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50262025-01-06T20:35:29.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 80a1d8f1-c57a-4a91-9585-f07109e8f969 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50272025-01-06T20:35:29.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 80a1d8f1-c57a-4a91-9585-f07109e8f969 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50282025-01-06T20:35:30.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3b9b85f3-9844-4985-ad2b-1187a3afc05f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50292025-01-06T20:35:30.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3b9b85f3-9844-4985-ad2b-1187a3afc05f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50302025-01-06T20:35:30.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3b9b85f3-9844-4985-ad2b-1187a3afc05f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50312025-01-06T20:35:31.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 850a9659-6458-4287-8261-58f01f1f5638 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50322025-01-06T20:35:31.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 850a9659-6458-4287-8261-58f01f1f5638 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50332025-01-06T20:35:31.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 850a9659-6458-4287-8261-58f01f1f5638 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50342025-01-06T20:35:32.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dbd7543d-3b2c-46cb-b7e2-29f53b5b5638 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50352025-01-06T20:35:32.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dbd7543d-3b2c-46cb-b7e2-29f53b5b5638 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50362025-01-06T20:35:32.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dbd7543d-3b2c-46cb-b7e2-29f53b5b5638 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50372025-01-06T20:35:32.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 006775aa-2dec-4b74-b116-2c594e489668 roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
50382025-01-06T20:35:32.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 006775aa-2dec-4b74-b116-2c594e489668 resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
50392025-01-06T20:35:32.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 006775aa-2dec-4b74-b116-2c594e489668 response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
50402025-01-06T20:35:32.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 4a8ed8d4-bc26-4ed4-b394-57337f0fad8c roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
50412025-01-06T20:35:32.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 4a8ed8d4-bc26-4ed4-b394-57337f0fad8c resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
50422025-01-06T20:35:32.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 4a8ed8d4-bc26-4ed4-b394-57337f0fad8c response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
50432025-01-06T20:35:33.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d237d724-a215-4345-9c43-75ec8a0b4310 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50442025-01-06T20:35:33.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d237d724-a215-4345-9c43-75ec8a0b4310 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50452025-01-06T20:35:33.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d237d724-a215-4345-9c43-75ec8a0b4310 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50462025-01-06T20:35:34.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0bde0519-220e-40d8-a5ba-01f44d5c717c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50472025-01-06T20:35:34.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0bde0519-220e-40d8-a5ba-01f44d5c717c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50482025-01-06T20:35:34.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1673 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0bde0519-220e-40d8-a5ba-01f44d5c717c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
50492025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
50502025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
50512025-01-06T20:35:34.988ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-06 20:25:34.988086851 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
50522025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
50532025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
50542025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50552025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
50562025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
50572025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
50582025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
50592025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50602025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50612025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
50622025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
50632025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
50642025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
50652025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50662025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
50672025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50682025-01-06T20:35:34.988ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468
50692025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
50702025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.11\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468"}
50712025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
50722025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
50732025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50742025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
50752025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50762025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
50772025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50782025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
50792025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
50802025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
50812025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
50822025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
50832025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50842025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
50852025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
50862025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
50872025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50882025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
50892025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50902025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
50912025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
50922025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50932025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50942025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
50952025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50962025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50972025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
50982025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50992025-01-06T20:35:34.988ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
51002025-01-06T20:35:34.988ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
51012025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51022025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51032025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
51042025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51052025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
51062025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
51072025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
51082025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51092025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51102025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
51112025-01-06T20:35:34.989ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
51122025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51132025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
51142025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
51152025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51162025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51172025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51182025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51192025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51202025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51212025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
51222025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
51232025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
51242025-01-06T20:35:34.989ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65bacdd1-9837-48ad-941c-aec5e2d79006.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1177, tv_nsec: 678329498 } })
51252025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51262025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51272025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51282025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51292025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
51302025-01-06T20:35:34.989ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("88aaaee6-38b4-4a83-9c08-04f0ea18e003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8dd67555-06fb-4cef-b914-9650f0eeb68a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1177, tv_nsec: 678453932 } })
51312025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51322025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51332025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51342025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51352025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51362025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51372025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
51382025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.339206ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
51392025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
51402025-01-06T20:35:34.989ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.47929ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
51412025-01-06T20:35:34.991ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-06 20:25:34.988086851 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
51422025-01-06T20:35:34.991ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.957241ms iteration = 8 status = {"expiration":"2025-01-06T20:25:34.988086851Z","pruned":[]}
51432025-01-06T20:35:34.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51442025-01-06T20:35:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51452025-01-06T20:35:34.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51462025-01-06T20:35:34.992ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1177, tv_nsec: 681710510 } })
51472025-01-06T20:35:34.992ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
51482025-01-06T20:35:34.992ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.690248ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
51492025-01-06T20:35:34.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51502025-01-06T20:35:34.993ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1177, tv_nsec: 682651556 } })
51512025-01-06T20:35:34.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51522025-01-06T20:35:34.993ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
51532025-01-06T20:35:34.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51542025-01-06T20:35:34.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51552025-01-06T20:35:34.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51562025-01-06T20:35:34.996ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51572025-01-06T20:35:34.997ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51582025-01-06T20:35:34.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
51592025-01-06T20:35:34.998ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51602025-01-06T20:35:34.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51612025-01-06T20:35:34.999ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51622025-01-06T20:35:34.999ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51632025-01-06T20:35:34.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51642025-01-06T20:35:35.001ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51652025-01-06T20:35:35.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51662025-01-06T20:35:35.003ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.006399ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
51672025-01-06T20:35:35.003ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51682025-01-06T20:35:35.003ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51692025-01-06T20:35:35.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51702025-01-06T20:35:35.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51712025-01-06T20:35:35.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51722025-01-06T20:35:35.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51732025-01-06T20:35:35.008ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51742025-01-06T20:35:35.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51752025-01-06T20:35:35.012ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51762025-01-06T20:35:35.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51772025-01-06T20:35:35.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51782025-01-06T20:35:35.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51792025-01-06T20:35:35.013ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51802025-01-06T20:35:35.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51812025-01-06T20:35:35.020ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51822025-01-06T20:35:35.020ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51832025-01-06T20:35:35.020ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51842025-01-06T20:35:35.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51852025-01-06T20:35:35.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51862025-01-06T20:35:35.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51872025-01-06T20:35:35.025ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51882025-01-06T20:35:35.025ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1177, tv_nsec: 714788761 } })
51892025-01-06T20:35:35.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51902025-01-06T20:35:35.026ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
51912025-01-06T20:35:35.027ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51922025-01-06T20:35:35.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51932025-01-06T20:35:35.029ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51942025-01-06T20:35:35.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51952025-01-06T20:35:35.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51962025-01-06T20:35:35.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
51972025-01-06T20:35:35.036ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51982025-01-06T20:35:35.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51992025-01-06T20:35:35.041ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
52002025-01-06T20:35:35.041ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
52012025-01-06T20:35:35.041ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 52.995182ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
52022025-01-06T20:35:35.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52032025-01-06T20:35:35.045ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.285229ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
52042025-01-06T20:35:35.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52052025-01-06T20:35:35.046ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52062025-01-06T20:35:35.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52072025-01-06T20:35:35.047ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52082025-01-06T20:35:35.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
52092025-01-06T20:35:35.052ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52102025-01-06T20:35:35.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52112025-01-06T20:35:35.059ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52122025-01-06T20:35:35.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52132025-01-06T20:35:35.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52142025-01-06T20:35:35.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52152025-01-06T20:35:35.070ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52162025-01-06T20:35:35.070ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 82.197278ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
52172025-01-06T20:35:35.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52182025-01-06T20:35:35.071ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52192025-01-06T20:35:35.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52202025-01-06T20:35:35.072ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 83.566785ms iteration = 17 status = {"physical_disks_added":0}
52212025-01-06T20:35:35.072ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52222025-01-06T20:35:35.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52232025-01-06T20:35:35.073ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
52242025-01-06T20:35:35.073ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.314302ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
52252025-01-06T20:35:35.078ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52262025-01-06T20:35:35.078ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 89.452096ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52272025-01-06T20:35:35.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52282025-01-06T20:35:35.080ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52292025-01-06T20:35:35.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
52302025-01-06T20:35:35.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52312025-01-06T20:35:35.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52322025-01-06T20:35:35.085ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
52332025-01-06T20:35:35.085ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 96.710993ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
52342025-01-06T20:35:35.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52352025-01-06T20:35:35.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52362025-01-06T20:35:35.087ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.83543ms iteration = 15 status = 0
52372025-01-06T20:35:35.087ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52382025-01-06T20:35:35.087ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52392025-01-06T20:35:35.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52402025-01-06T20:35:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52412025-01-06T20:35:35.088ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52422025-01-06T20:35:35.088ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52432025-01-06T20:35:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52442025-01-06T20:35:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52452025-01-06T20:35:35.089ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52462025-01-06T20:35:35.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52472025-01-06T20:35:35.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52482025-01-06T20:35:35.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
52492025-01-06T20:35:35.090ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
52502025-01-06T20:35:35.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
52512025-01-06T20:35:35.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 102.402428ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52522025-01-06T20:35:35.091ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52532025-01-06T20:35:35.091ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52542025-01-06T20:35:35.091ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 102.521691ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
52552025-01-06T20:35:35.095ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52562025-01-06T20:35:35.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52572025-01-06T20:35:35.100ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
52582025-01-06T20:35:35.100ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
52592025-01-06T20:35:35.100ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
52602025-01-06T20:35:35.100ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52612025-01-06T20:35:35.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52622025-01-06T20:35:35.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52632025-01-06T20:35:35.106ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52642025-01-06T20:35:35.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52652025-01-06T20:35:35.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52662025-01-06T20:35:35.106ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52672025-01-06T20:35:35.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52682025-01-06T20:35:35.115ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52692025-01-06T20:35:35.115ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 127.141881ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52702025-01-06T20:35:35.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52712025-01-06T20:35:35.119ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
52722025-01-06T20:35:35.119ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
52732025-01-06T20:35:35.119ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
52742025-01-06T20:35:35.119ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52752025-01-06T20:35:35.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52762025-01-06T20:35:35.130ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 141.990385ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
52772025-01-06T20:35:35.143ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
52782025-01-06T20:35:35.143ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
52792025-01-06T20:35:35.143ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 155.194265ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
52802025-01-06T20:35:35.148ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
52812025-01-06T20:35:35.156ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
52822025-01-06T20:35:35.156ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52832025-01-06T20:35:35.156ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ce2ed3f-ee60-42f5-9aef-ec4572b37b28", "content-length": "26", "date": "Mon, 06 Jan 2025 20:35:35 GMT"} })
52842025-01-06T20:35:35.156ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52852025-01-06T20:35:35.159ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52862025-01-06T20:35:35.180ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52872025-01-06T20:35:35.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52882025-01-06T20:35:35.181ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
52892025-01-06T20:35:35.246ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
52902025-01-06T20:35:35.246ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 257.374666ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
52912025-01-06T20:35:35.255ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
52922025-01-06T20:35:35.255ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52932025-01-06T20:35:35.255ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a764136-1fc0-4673-b43e-7672e56fc4d8", "content-length": "26", "date": "Mon, 06 Jan 2025 20:35:35 GMT"} })
52942025-01-06T20:35:35.255ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52952025-01-06T20:35:35.260ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52962025-01-06T20:35:35.339ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
52972025-01-06T20:35:35.340ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "00ae8144-3389-469e-a32e-80371bc20d1e", "date": "Mon, 06 Jan 2025 20:35:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52982025-01-06T20:35:35.340ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
52992025-01-06T20:35:35.343ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
53002025-01-06T20:35:35.343ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53012025-01-06T20:35:35.343ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4f7b215-4b56-487e-9e52-5db09dd34228", "content-length": "26", "date": "Mon, 06 Jan 2025 20:35:35 GMT"} })
53022025-01-06T20:35:35.343ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53032025-01-06T20:35:35.344ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c700fe03-b6ee-41ae-ad19-8254a3fd5b58", "date": "Mon, 06 Jan 2025 20:35:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53042025-01-06T20:35:35.344ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53052025-01-06T20:35:35.349ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
53062025-01-06T20:35:35.351ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53072025-01-06T20:35:35.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 363.033812ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
53082025-01-06T20:35:35.351ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 363.788492ms iteration = 15 status = {}
53092025-01-06T20:35:35.406ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
53102025-01-06T20:35:35.414ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
53112025-01-06T20:35:35.414ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53122025-01-06T20:35:35.418ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "355d7524-4b4f-483b-af8c-507a2c82c88f", "content-length": "372", "date": "Mon, 06 Jan 2025 20:35:35 GMT"} })
53132025-01-06T20:35:35.418ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53142025-01-06T20:35:35.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53152025-01-06T20:35:35.421ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53162025-01-06T20:35:35.424ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
53172025-01-06T20:35:35.424ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53182025-01-06T20:35:35.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53192025-01-06T20:35:35.428ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
53202025-01-06T20:35:35.428ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "346fed1b-80a3-4287-bb76-67a9ce894d62", "content-length": "1", "date": "Mon, 06 Jan 2025 20:35:34 GMT"} })
53212025-01-06T20:35:35.431ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53222025-01-06T20:35:35.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53232025-01-06T20:35:35.434ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 446.113333ms iteration = 15 status = null
53242025-01-06T20:35:35.461ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53252025-01-06T20:35:35.463ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
53262025-01-06T20:35:35.463ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 0 version = 2
53272025-01-06T20:35:35.463ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53282025-01-06T20:35:35.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53292025-01-06T20:35:35.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53302025-01-06T20:35:35.464ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53312025-01-06T20:35:35.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53322025-01-06T20:35:35.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53332025-01-06T20:35:35.466ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-06T20:28:32.843602Z, time_modified: 2025-01-06T20:28:32.843602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }) }
53342025-01-06T20:35:35.466ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 478.630509ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]}},"default_endpoint":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
53352025-01-06T20:35:35.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53362025-01-06T20:35:35.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53372025-01-06T20:35:35.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53382025-01-06T20:35:35.472ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 1 version = 2
53392025-01-06T20:35:35.472ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
53402025-01-06T20:35:35.473ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-06 20:28:37.181288 UTC dns_group = external generation = 2
53412025-01-06T20:35:35.473ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 484.721334ms iteration = 8 status = {"generation":2}
53422025-01-06T20:35:35.480ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
53432025-01-06T20:35:35.480ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
53442025-01-06T20:35:35.481ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b4045cb3-cb88-4495-8378-bd7731c4d56e", "date": "Mon, 06 Jan 2025 20:35:35 GMT"} })
53452025-01-06T20:35:35.481ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53462025-01-06T20:35:35.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53472025-01-06T20:35:35.483ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53482025-01-06T20:35:35.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53492025-01-06T20:35:35.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53502025-01-06T20:35:35.487ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
53512025-01-06T20:35:35.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53522025-01-06T20:35:35.488ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "148da867-f989-4a97-9c67-ad14c78f5fe7", "date": "Mon, 06 Jan 2025 20:35:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53532025-01-06T20:35:35.488ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53542025-01-06T20:35:35.490ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "87364328-5fdb-4606-b16f-19422054c415", "date": "Mon, 06 Jan 2025 20:35:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53552025-01-06T20:35:35.490ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53562025-01-06T20:35:35.491ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f55ccf9f-5b86-49db-984b-f1254129c335", "date": "Mon, 06 Jan 2025 20:35:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53572025-01-06T20:35:35.491ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53582025-01-06T20:35:35.491ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
53592025-01-06T20:35:35.491ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53602025-01-06T20:35:35.492ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5314daa6-6c56-43cf-acbb-a447cb6cdf18", "date": "Mon, 06 Jan 2025 20:35:35 GMT"} })
53612025-01-06T20:35:35.494ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
53622025-01-06T20:35:35.494ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 506.140157ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
53632025-01-06T20:35:35.494ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 505.618463ms iteration = 15 status = {}
53642025-01-06T20:35:35.500ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
53652025-01-06T20:35:35.500ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
53662025-01-06T20:35:35.500ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53672025-01-06T20:35:35.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53682025-01-06T20:35:35.502ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53692025-01-06T20:35:35.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53702025-01-06T20:35:35.505ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53712025-01-06T20:35:35.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53722025-01-06T20:35:35.508ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
53732025-01-06T20:35:35.508ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
53742025-01-06T20:35:35.508ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-06 20:28:35.848690 UTC dns_group = internal generation = 1
53752025-01-06T20:35:35.508ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 520.274232ms iteration = 8 status = {"generation":1}
53762025-01-06T20:35:35.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53772025-01-06T20:35:35.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53782025-01-06T20:35:35.545ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
53792025-01-06T20:35:35.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53802025-01-06T20:35:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53812025-01-06T20:35:35.552ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53822025-01-06T20:35:35.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53832025-01-06T20:35:35.555ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53842025-01-06T20:35:35.558ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53852025-01-06T20:35:35.558ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53862025-01-06T20:35:35.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53872025-01-06T20:35:35.561ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53882025-01-06T20:35:35.563ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53892025-01-06T20:35:35.563ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53902025-01-06T20:35:35.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53912025-01-06T20:35:35.564ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
53922025-01-06T20:35:35.565ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b489db26-a6c6-496c-8fbc-dfc77c46f4d5", "content-length": "134", "date": "Mon, 06 Jan 2025 20:35:35 GMT"} })
53932025-01-06T20:35:35.565ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
53942025-01-06T20:35:35.565ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
53952025-01-06T20:35:35.565ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
53962025-01-06T20:35:35.565ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
53972025-01-06T20:35:35.565ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53982025-01-06T20:35:35.565ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53992025-01-06T20:35:35.565ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54002025-01-06T20:35:35.565ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54012025-01-06T20:35:35.565ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54022025-01-06T20:35:35.565ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54032025-01-06T20:35:35.565ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
54042025-01-06T20:35:35.565ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54052025-01-06T20:35:35.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54062025-01-06T20:35:35.568ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
54072025-01-06T20:35:35.569ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "efafdd47-0ebf-4dc5-8826-2c69fbbaf445", "content-length": "2", "date": "Mon, 06 Jan 2025 20:35:35 GMT"} })
54082025-01-06T20:35:35.569ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
54092025-01-06T20:35:35.569ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ef2602e-72f7-461f-aa3f-0d03753f3a77", "content-length": "52", "date": "Mon, 06 Jan 2025 20:35:35 GMT"} })
54102025-01-06T20:35:35.569ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
54112025-01-06T20:35:35.569ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
54122025-01-06T20:35:35.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ce8982de-5b96-44a3-9567-f8c237d5dced roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54132025-01-06T20:35:35.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ce8982de-5b96-44a3-9567-f8c237d5dced resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54142025-01-06T20:35:35.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ce8982de-5b96-44a3-9567-f8c237d5dced response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54152025-01-06T20:35:35.609ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54162025-01-06T20:35:35.609ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c3603f8-ac56-4b78-8c6d-0acb23d81493", "content-length": "691", "date": "Mon, 06 Jan 2025 20:35:35 GMT"} })
54172025-01-06T20:35:35.609ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
54182025-01-06T20:35:35.609ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
54192025-01-06T20:35:35.609ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
54202025-01-06T20:35:35.611ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 622.811583ms iteration = 15 status = {}
54212025-01-06T20:35:35.693ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2b51f439-3a8e-4362-b352-786b1e1e3f9f", "date": "Mon, 06 Jan 2025 20:35:35 GMT"} })
54222025-01-06T20:35:35.693ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
54232025-01-06T20:35:35.693ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
54242025-01-06T20:35:35.694ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dbd8eaf-6073-446a-abf0-7020fad7a204", "content-length": "682", "date": "Mon, 06 Jan 2025 20:35:35 GMT"} })
54252025-01-06T20:35:35.694ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54262025-01-06T20:35:35.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54272025-01-06T20:35:35.698ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54282025-01-06T20:35:35.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54292025-01-06T20:35:35.701ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54302025-01-06T20:35:35.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54312025-01-06T20:35:35.703ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54322025-01-06T20:35:35.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54332025-01-06T20:35:35.711ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 723.024912ms iteration = 15 status = {}
54342025-01-06T20:35:36.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 667ebdc7-7c1b-4e3e-b12e-d38ed74ab30a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54352025-01-06T20:35:36.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 667ebdc7-7c1b-4e3e-b12e-d38ed74ab30a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54362025-01-06T20:35:36.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 667ebdc7-7c1b-4e3e-b12e-d38ed74ab30a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54372025-01-06T20:35:37.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dc45529f-a8cd-42d1-a727-1322011c4e40 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54382025-01-06T20:35:37.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dc45529f-a8cd-42d1-a727-1322011c4e40 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54392025-01-06T20:35:37.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dc45529f-a8cd-42d1-a727-1322011c4e40 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54402025-01-06T20:35:37.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 567 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 5d2c70a5-16da-4e6f-80c1-f92d3fb97b0c response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
54412025-01-06T20:35:38.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d3384ff0-0d54-4e72-82b2-a2d82df1b534 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54422025-01-06T20:35:38.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d3384ff0-0d54-4e72-82b2-a2d82df1b534 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54432025-01-06T20:35:38.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d3384ff0-0d54-4e72-82b2-a2d82df1b534 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54442025-01-06T20:35:39.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c946aa8b-2ad9-4114-a7b2-af1d9083a59e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54452025-01-06T20:35:39.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c946aa8b-2ad9-4114-a7b2-af1d9083a59e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54462025-01-06T20:35:39.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c946aa8b-2ad9-4114-a7b2-af1d9083a59e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54472025-01-06T20:35:40.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7f24cfd2-59b6-441f-8a2b-7e11ed7d99c5 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54482025-01-06T20:35:40.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7f24cfd2-59b6-441f-8a2b-7e11ed7d99c5 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54492025-01-06T20:35:40.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7f24cfd2-59b6-441f-8a2b-7e11ed7d99c5 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54502025-01-06T20:35:41.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 06c2f103-293f-4e8e-a74b-051fe1a4e468 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54512025-01-06T20:35:41.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 06c2f103-293f-4e8e-a74b-051fe1a4e468 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54522025-01-06T20:35:41.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 06c2f103-293f-4e8e-a74b-051fe1a4e468 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54532025-01-06T20:35:42.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b73beaba-83a6-4f5e-b672-a928a73b0e3f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54542025-01-06T20:35:42.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b73beaba-83a6-4f5e-b672-a928a73b0e3f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54552025-01-06T20:35:42.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b73beaba-83a6-4f5e-b672-a928a73b0e3f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54562025-01-06T20:35:43.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0abb2d1c-d455-4375-97bc-c1c0a9ba33e4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54572025-01-06T20:35:43.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0abb2d1c-d455-4375-97bc-c1c0a9ba33e4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54582025-01-06T20:35:43.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0abb2d1c-d455-4375-97bc-c1c0a9ba33e4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54592025-01-06T20:35:44.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 08369f95-c7b2-43f1-9519-328b5171e9f1 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54602025-01-06T20:35:44.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 08369f95-c7b2-43f1-9519-328b5171e9f1 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54612025-01-06T20:35:44.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 08369f95-c7b2-43f1-9519-328b5171e9f1 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54622025-01-06T20:35:44.987ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
54632025-01-06T20:35:44.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54642025-01-06T20:35:44.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54652025-01-06T20:35:44.988ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
54662025-01-06T20:35:44.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54672025-01-06T20:35:44.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54682025-01-06T20:35:45.017ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54692025-01-06T20:35:45.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54702025-01-06T20:35:45.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54712025-01-06T20:35:45.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54722025-01-06T20:35:45.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54732025-01-06T20:35:45.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54742025-01-06T20:35:45.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54752025-01-06T20:35:45.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54762025-01-06T20:35:45.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54772025-01-06T20:35:45.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
54782025-01-06T20:35:45.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54792025-01-06T20:35:45.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54802025-01-06T20:35:45.037ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
54812025-01-06T20:35:45.037ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.342181ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
54822025-01-06T20:35:45.046ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.172644ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54832025-01-06T20:35:45.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bb13aea7-aabf-4602-9b93-6244ce694037 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54842025-01-06T20:35:45.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bb13aea7-aabf-4602-9b93-6244ce694037 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54852025-01-06T20:35:45.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bb13aea7-aabf-4602-9b93-6244ce694037 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54862025-01-06T20:35:46.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 076a1f46-db69-412c-8cef-6b1ec58e1c24 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54872025-01-06T20:35:46.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 076a1f46-db69-412c-8cef-6b1ec58e1c24 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54882025-01-06T20:35:46.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 076a1f46-db69-412c-8cef-6b1ec58e1c24 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54892025-01-06T20:35:47.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = e7d31bc4-0186-4a2d-acda-ae977f62d0f5 roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
54902025-01-06T20:35:47.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = e7d31bc4-0186-4a2d-acda-ae977f62d0f5 resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
54912025-01-06T20:35:47.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2757 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = e7d31bc4-0186-4a2d-acda-ae977f62d0f5 response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
54922025-01-06T20:35:47.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 1b56479a-89bb-418c-8319-cdf76a34a1a6 roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
54932025-01-06T20:35:47.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 1b56479a-89bb-418c-8319-cdf76a34a1a6 resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
54942025-01-06T20:35:47.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 1b56479a-89bb-418c-8319-cdf76a34a1a6 response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
54952025-01-06T20:35:47.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 503 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 671c81ab-7b13-4f1f-9d6c-17cb376fbc6a response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
54962025-01-06T20:35:47.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = db2be0a0-ba72-4780-8596-3811f3f4ac04 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54972025-01-06T20:35:47.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = db2be0a0-ba72-4780-8596-3811f3f4ac04 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54982025-01-06T20:35:47.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1838 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = db2be0a0-ba72-4780-8596-3811f3f4ac04 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
54992025-01-06T20:35:48.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d919df4f-b250-4d6d-a75e-30b0f10fe5d1 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55002025-01-06T20:35:48.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d919df4f-b250-4d6d-a75e-30b0f10fe5d1 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55012025-01-06T20:35:48.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d919df4f-b250-4d6d-a75e-30b0f10fe5d1 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55022025-01-06T20:35:49.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cae35eb3-fa29-4a57-a740-2f437ada178c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55032025-01-06T20:35:49.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cae35eb3-fa29-4a57-a740-2f437ada178c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55042025-01-06T20:35:49.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cae35eb3-fa29-4a57-a740-2f437ada178c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55052025-01-06T20:35:50.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 832dd147-d296-4a4f-9e9e-7af317297f7d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55062025-01-06T20:35:50.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 832dd147-d296-4a4f-9e9e-7af317297f7d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55072025-01-06T20:35:50.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 832dd147-d296-4a4f-9e9e-7af317297f7d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55082025-01-06T20:35:51.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7ac0eb81-cf1b-478f-a28d-abd87553ea58 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55092025-01-06T20:35:51.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7ac0eb81-cf1b-478f-a28d-abd87553ea58 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55102025-01-06T20:35:51.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7ac0eb81-cf1b-478f-a28d-abd87553ea58 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55112025-01-06T20:35:52.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4bdade32-ab16-496b-becd-bce324e957f4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55122025-01-06T20:35:52.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4bdade32-ab16-496b-becd-bce324e957f4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55132025-01-06T20:35:52.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4bdade32-ab16-496b-becd-bce324e957f4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55142025-01-06T20:35:53.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bc6ba41c-bcd3-4e8f-ac08-a80df6dfbfd6 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55152025-01-06T20:35:53.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bc6ba41c-bcd3-4e8f-ac08-a80df6dfbfd6 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55162025-01-06T20:35:53.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bc6ba41c-bcd3-4e8f-ac08-a80df6dfbfd6 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55172025-01-06T20:35:54.987ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
55182025-01-06T20:35:54.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55192025-01-06T20:35:54.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55202025-01-06T20:35:54.988ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
55212025-01-06T20:35:54.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55222025-01-06T20:35:54.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55232025-01-06T20:35:54.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55242025-01-06T20:35:54.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55252025-01-06T20:35:54.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55262025-01-06T20:35:54.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55272025-01-06T20:35:54.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55282025-01-06T20:35:54.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55292025-01-06T20:35:54.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55302025-01-06T20:35:54.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
55312025-01-06T20:35:54.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55322025-01-06T20:35:54.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55332025-01-06T20:35:55.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a9deb2e3-7e63-4415-9aa7-5dbb4ba2b749 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55342025-01-06T20:35:55.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a9deb2e3-7e63-4415-9aa7-5dbb4ba2b749 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55352025-01-06T20:35:55.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a9deb2e3-7e63-4415-9aa7-5dbb4ba2b749 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55362025-01-06T20:35:55.010ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
55372025-01-06T20:35:55.010ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.557354ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
55382025-01-06T20:35:55.016ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55392025-01-06T20:35:55.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55402025-01-06T20:35:55.048ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.075165ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55412025-01-06T20:35:56.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3643b6fe-20a6-41c2-b1c9-07f6bc4ecadd roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55422025-01-06T20:35:56.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3643b6fe-20a6-41c2-b1c9-07f6bc4ecadd resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55432025-01-06T20:35:56.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3643b6fe-20a6-41c2-b1c9-07f6bc4ecadd response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55442025-01-06T20:35:57.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 985bc9db-b096-44be-85d7-3c933469f644 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55452025-01-06T20:35:57.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 985bc9db-b096-44be-85d7-3c933469f644 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55462025-01-06T20:35:57.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 985bc9db-b096-44be-85d7-3c933469f644 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55472025-01-06T20:35:57.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 584 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = c2c65055-9c43-4746-825b-a205d146d375 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
55482025-01-06T20:35:58.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f7b1fa37-3b1b-4781-9239-09dbdd045fb7 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55492025-01-06T20:35:58.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f7b1fa37-3b1b-4781-9239-09dbdd045fb7 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55502025-01-06T20:35:58.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f7b1fa37-3b1b-4781-9239-09dbdd045fb7 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55512025-01-06T20:35:59.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e58805fa-1ecd-48d6-a646-80f84d87ae9c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55522025-01-06T20:35:59.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e58805fa-1ecd-48d6-a646-80f84d87ae9c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55532025-01-06T20:35:59.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e58805fa-1ecd-48d6-a646-80f84d87ae9c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55542025-01-06T20:36:00.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0f43ab0f-0219-4fa0-b5f1-34e768cf0776 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55552025-01-06T20:36:00.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0f43ab0f-0219-4fa0-b5f1-34e768cf0776 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55562025-01-06T20:36:00.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0f43ab0f-0219-4fa0-b5f1-34e768cf0776 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55572025-01-06T20:36:01.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cb723fa8-8720-4abc-b696-486bd0a72d30 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55582025-01-06T20:36:01.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cb723fa8-8720-4abc-b696-486bd0a72d30 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55592025-01-06T20:36:01.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2669 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cb723fa8-8720-4abc-b696-486bd0a72d30 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55602025-01-06T20:36:02.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d28f5064-6c87-45d5-93c1-92bba1a071b4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55612025-01-06T20:36:02.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d28f5064-6c87-45d5-93c1-92bba1a071b4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55622025-01-06T20:36:02.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d28f5064-6c87-45d5-93c1-92bba1a071b4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55632025-01-06T20:36:03.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 36d263b0-900c-43f0-ab52-e978109a8c47 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55642025-01-06T20:36:03.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 36d263b0-900c-43f0-ab52-e978109a8c47 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55652025-01-06T20:36:03.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1788 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 36d263b0-900c-43f0-ab52-e978109a8c47 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55662025-01-06T20:36:04.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e4d07828-30ec-4ce5-8b49-fbb2c407ef7a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55672025-01-06T20:36:04.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e4d07828-30ec-4ce5-8b49-fbb2c407ef7a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55682025-01-06T20:36:04.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e4d07828-30ec-4ce5-8b49-fbb2c407ef7a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
55692025-01-06T20:36:04.987ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
55702025-01-06T20:36:04.987ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
55712025-01-06T20:36:04.987ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55722025-01-06T20:36:04.987ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
55732025-01-06T20:36:04.987ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
55742025-01-06T20:36:04.987ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
55752025-01-06T20:36:04.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55762025-01-06T20:36:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55772025-01-06T20:36:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
55782025-01-06T20:36:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55792025-01-06T20:36:04.988ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
55802025-01-06T20:36:04.988ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
55812025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55822025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55832025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
55842025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55852025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
55862025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
55872025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
55882025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55892025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
55902025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
55912025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
55922025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55932025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
55942025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55952025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
55962025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55972025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
55982025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
55992025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
56002025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56012025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56022025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
56032025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56042025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
56052025-01-06T20:36:04.989ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
56062025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56072025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56082025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56092025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56102025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
56112025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56122025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56132025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
56142025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56152025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56162025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56172025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56182025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56192025-01-06T20:36:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56202025-01-06T20:36:04.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56212025-01-06T20:36:04.990ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.955391ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56222025-01-06T20:36:04.990ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1207, tv_nsec: 680189789 } })
56232025-01-06T20:36:04.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56242025-01-06T20:36:04.990ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1207, tv_nsec: 680354443 } })
56252025-01-06T20:36:04.991ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
56262025-01-06T20:36:04.991ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56272025-01-06T20:36:04.991ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
56282025-01-06T20:36:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56292025-01-06T20:36:04.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56302025-01-06T20:36:04.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56312025-01-06T20:36:04.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56322025-01-06T20:36:04.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
56332025-01-06T20:36:04.998ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56342025-01-06T20:36:04.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56352025-01-06T20:36:04.999ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56362025-01-06T20:36:05.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
56372025-01-06T20:36:05.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56382025-01-06T20:36:05.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56392025-01-06T20:36:05.004ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56402025-01-06T20:36:05.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56412025-01-06T20:36:05.006ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56422025-01-06T20:36:05.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56432025-01-06T20:36:05.007ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56442025-01-06T20:36:05.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56452025-01-06T20:36:05.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56462025-01-06T20:36:05.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
56472025-01-06T20:36:05.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56482025-01-06T20:36:05.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56492025-01-06T20:36:05.012ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1207, tv_nsec: 701453438 } })
56502025-01-06T20:36:05.012ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
56512025-01-06T20:36:05.014ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56522025-01-06T20:36:05.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56532025-01-06T20:36:05.025ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56542025-01-06T20:36:05.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56552025-01-06T20:36:05.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56562025-01-06T20:36:05.032ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56572025-01-06T20:36:05.032ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56582025-01-06T20:36:05.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56592025-01-06T20:36:05.056ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56602025-01-06T20:36:05.056ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
56612025-01-06T20:36:05.056ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56622025-01-06T20:36:05.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56632025-01-06T20:36:05.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56642025-01-06T20:36:05.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56652025-01-06T20:36:05.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56662025-01-06T20:36:05.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56672025-01-06T20:36:05.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56682025-01-06T20:36:05.061ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56692025-01-06T20:36:05.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56702025-01-06T20:36:05.061ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 72.765571ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
56712025-01-06T20:36:05.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56722025-01-06T20:36:05.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56732025-01-06T20:36:05.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56742025-01-06T20:36:05.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56752025-01-06T20:36:05.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56762025-01-06T20:36:05.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56772025-01-06T20:36:05.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56782025-01-06T20:36:05.078ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 89.392914ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
56792025-01-06T20:36:05.078ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
56802025-01-06T20:36:05.078ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.527027ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
56812025-01-06T20:36:05.083ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.476392ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56822025-01-06T20:36:05.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56832025-01-06T20:36:05.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
56842025-01-06T20:36:05.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56852025-01-06T20:36:05.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56862025-01-06T20:36:05.091ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
56872025-01-06T20:36:05.091ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56882025-01-06T20:36:05.092ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec335986-0c07-4ac6-9a9a-55eaf709f06f", "content-length": "26", "date": "Mon, 06 Jan 2025 20:36:05 GMT"} })
56892025-01-06T20:36:05.092ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56902025-01-06T20:36:05.095ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56912025-01-06T20:36:05.104ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 115.054562ms iteration = 18 status = {"physical_disks_added":0}
56922025-01-06T20:36:05.107ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56932025-01-06T20:36:05.107ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
56942025-01-06T20:36:05.107ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56952025-01-06T20:36:05.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56962025-01-06T20:36:05.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
56972025-01-06T20:36:05.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56982025-01-06T20:36:05.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 120.194412ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
56992025-01-06T20:36:05.109ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
57002025-01-06T20:36:05.109ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57012025-01-06T20:36:05.109ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 120.242953ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57022025-01-06T20:36:05.109ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4a376f4-2c53-404e-bbe1-ec50e9110f77", "content-length": "26", "date": "Mon, 06 Jan 2025 20:36:05 GMT"} })
57032025-01-06T20:36:05.109ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57042025-01-06T20:36:05.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
57052025-01-06T20:36:05.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57062025-01-06T20:36:05.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57072025-01-06T20:36:05.111ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57082025-01-06T20:36:05.113ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 124.421897ms iteration = 16 status = 0
57092025-01-06T20:36:05.120ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57102025-01-06T20:36:05.122ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 133.171595ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57112025-01-06T20:36:05.122ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57122025-01-06T20:36:05.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57132025-01-06T20:36:05.123ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57142025-01-06T20:36:05.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57152025-01-06T20:36:05.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57162025-01-06T20:36:05.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 136.520727ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
57172025-01-06T20:36:05.142ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57182025-01-06T20:36:05.142ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
57192025-01-06T20:36:05.142ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 153.511899ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
57202025-01-06T20:36:05.155ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57212025-01-06T20:36:05.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57222025-01-06T20:36:05.166ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
57232025-01-06T20:36:05.166ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57242025-01-06T20:36:05.166ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffe2c676-38ff-4e36-adaf-068a97afe8fe", "content-length": "26", "date": "Mon, 06 Jan 2025 20:36:05 GMT"} })
57252025-01-06T20:36:05.166ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57262025-01-06T20:36:05.168ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
57272025-01-06T20:36:05.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 261be0ae-52b1-4ee0-bedd-91e7d41c6baa roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
57282025-01-06T20:36:05.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 261be0ae-52b1-4ee0-bedd-91e7d41c6baa resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
57292025-01-06T20:36:05.228ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
57302025-01-06T20:36:05.228ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0955880-4302-4fe0-ad17-c9fc44e2f76f", "content-length": "1", "date": "Mon, 06 Jan 2025 20:36:04 GMT"} })
57312025-01-06T20:36:05.228ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 241.34723ms iteration = 16 status = {}
57322025-01-06T20:36:05.230ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57332025-01-06T20:36:05.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57342025-01-06T20:36:05.236ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
57352025-01-06T20:36:05.236ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57362025-01-06T20:36:05.236ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "79171f8a-b9ab-46cf-b3ce-30d140606903", "content-length": "372", "date": "Mon, 06 Jan 2025 20:36:05 GMT"} })
57372025-01-06T20:36:05.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57382025-01-06T20:36:05.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57392025-01-06T20:36:05.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 261be0ae-52b1-4ee0-bedd-91e7d41c6baa response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
57402025-01-06T20:36:05.239ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 251.785064ms iteration = 16 status = null
57412025-01-06T20:36:05.258ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
57422025-01-06T20:36:05.258ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
57432025-01-06T20:36:05.258ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d863cdba-2008-47a7-adb6-1f19981f2d8c", "date": "Mon, 06 Jan 2025 20:36:05 GMT"} })
57442025-01-06T20:36:05.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57452025-01-06T20:36:05.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57462025-01-06T20:36:05.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57472025-01-06T20:36:05.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57482025-01-06T20:36:05.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57492025-01-06T20:36:05.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57502025-01-06T20:36:05.266ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57512025-01-06T20:36:05.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57522025-01-06T20:36:05.267ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
57532025-01-06T20:36:05.267ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57542025-01-06T20:36:05.267ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4483476c-3888-4dac-a49d-89c5653453a1", "date": "Mon, 06 Jan 2025 20:36:05 GMT"} })
57552025-01-06T20:36:05.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57562025-01-06T20:36:05.269ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 280.207928ms iteration = 16 status = {}
57572025-01-06T20:36:05.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57582025-01-06T20:36:05.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57592025-01-06T20:36:05.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57602025-01-06T20:36:05.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57612025-01-06T20:36:05.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57622025-01-06T20:36:05.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57632025-01-06T20:36:05.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57642025-01-06T20:36:05.327ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57652025-01-06T20:36:05.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57662025-01-06T20:36:05.330ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
57672025-01-06T20:36:05.330ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57682025-01-06T20:36:05.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57692025-01-06T20:36:05.340ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
57702025-01-06T20:36:05.340ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "43e4901d-7c2f-4171-8e77-3f23e74bd671", "content-length": "134", "date": "Mon, 06 Jan 2025 20:36:04 GMT"} })
57712025-01-06T20:36:05.340ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
57722025-01-06T20:36:05.340ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
57732025-01-06T20:36:05.341ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
57742025-01-06T20:36:05.341ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57752025-01-06T20:36:05.341ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57762025-01-06T20:36:05.341ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57772025-01-06T20:36:05.341ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57782025-01-06T20:36:05.341ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57792025-01-06T20:36:05.341ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57802025-01-06T20:36:05.341ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57812025-01-06T20:36:05.341ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
57822025-01-06T20:36:05.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57832025-01-06T20:36:05.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57842025-01-06T20:36:05.344ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
57852025-01-06T20:36:05.344ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "542a7a6e-d6b6-4ccb-a1fa-810c81d35dcc", "content-length": "2", "date": "Mon, 06 Jan 2025 20:36:04 GMT"} })
57862025-01-06T20:36:05.344ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
57872025-01-06T20:36:05.344ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1b13b20-efd3-41d7-8b2b-e0cd19649690", "content-length": "52", "date": "Mon, 06 Jan 2025 20:36:04 GMT"} })
57882025-01-06T20:36:05.344ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
57892025-01-06T20:36:05.344ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57902025-01-06T20:36:05.376ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
57912025-01-06T20:36:05.440ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "acccc5ba-e92e-4a96-9527-d99b7eeac1f1", "date": "Mon, 06 Jan 2025 20:36:05 GMT"} })
57922025-01-06T20:36:05.440ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
57932025-01-06T20:36:05.440ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
57942025-01-06T20:36:05.441ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "895de283-d5f1-4de0-802e-4860582d33bf", "content-length": "682", "date": "Mon, 06 Jan 2025 20:36:05 GMT"} })
57952025-01-06T20:36:05.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57962025-01-06T20:36:05.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57972025-01-06T20:36:05.444ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "984eac58-cc9f-4995-970f-f885d59368e3", "content-length": "691", "date": "Mon, 06 Jan 2025 20:36:05 GMT"} })
57982025-01-06T20:36:05.444ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
57992025-01-06T20:36:05.444ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
58002025-01-06T20:36:05.444ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
58012025-01-06T20:36:05.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58022025-01-06T20:36:05.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58032025-01-06T20:36:05.446ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 457.234876ms iteration = 16 status = {}
58042025-01-06T20:36:05.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58052025-01-06T20:36:05.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58062025-01-06T20:36:05.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58072025-01-06T20:36:05.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58082025-01-06T20:36:05.457ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 468.898654ms iteration = 16 status = {}
58092025-01-06T20:36:06.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 37724c04-31a0-4eb3-8710-fbbecf5a83a4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58102025-01-06T20:36:06.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 37724c04-31a0-4eb3-8710-fbbecf5a83a4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58112025-01-06T20:36:06.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 37724c04-31a0-4eb3-8710-fbbecf5a83a4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58122025-01-06T20:36:07.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c34a2450-36cd-4763-808c-4808ae1da8e0 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58132025-01-06T20:36:07.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c34a2450-36cd-4763-808c-4808ae1da8e0 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58142025-01-06T20:36:07.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c34a2450-36cd-4763-808c-4808ae1da8e0 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58152025-01-06T20:36:07.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 556 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 8fed5fdd-6d72-4128-9b43-f0526da1a66f response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
58162025-01-06T20:36:08.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 733780b4-0d3c-48b8-9703-80fdedaee425 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58172025-01-06T20:36:08.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 733780b4-0d3c-48b8-9703-80fdedaee425 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58182025-01-06T20:36:08.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 733780b4-0d3c-48b8-9703-80fdedaee425 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58192025-01-06T20:36:09.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = df6d0675-622a-44db-9d82-327fbcd978fe roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58202025-01-06T20:36:09.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = df6d0675-622a-44db-9d82-327fbcd978fe resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58212025-01-06T20:36:09.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = df6d0675-622a-44db-9d82-327fbcd978fe response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58222025-01-06T20:36:10.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e216bb73-a3d1-41f6-8fcf-4de0cb78ec1c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58232025-01-06T20:36:10.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e216bb73-a3d1-41f6-8fcf-4de0cb78ec1c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58242025-01-06T20:36:10.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2709 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e216bb73-a3d1-41f6-8fcf-4de0cb78ec1c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58252025-01-06T20:36:11.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e6109739-7293-4509-a67e-f0fce346e622 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58262025-01-06T20:36:11.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e6109739-7293-4509-a67e-f0fce346e622 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58272025-01-06T20:36:11.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e6109739-7293-4509-a67e-f0fce346e622 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58282025-01-06T20:36:12.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fcdca646-c697-456e-a972-a2f28586591c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58292025-01-06T20:36:12.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fcdca646-c697-456e-a972-a2f28586591c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58302025-01-06T20:36:12.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fcdca646-c697-456e-a972-a2f28586591c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58312025-01-06T20:36:13.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 45ec09d1-3d9c-4658-bb01-ad461529740d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58322025-01-06T20:36:13.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 45ec09d1-3d9c-4658-bb01-ad461529740d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58332025-01-06T20:36:13.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 45ec09d1-3d9c-4658-bb01-ad461529740d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58342025-01-06T20:36:14.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f7bcc658-b73a-42d9-9f1b-f2b73be01754 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58352025-01-06T20:36:14.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f7bcc658-b73a-42d9-9f1b-f2b73be01754 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58362025-01-06T20:36:14.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f7bcc658-b73a-42d9-9f1b-f2b73be01754 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58372025-01-06T20:36:14.987ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
58382025-01-06T20:36:14.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58392025-01-06T20:36:14.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58402025-01-06T20:36:14.988ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
58412025-01-06T20:36:14.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58422025-01-06T20:36:14.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58432025-01-06T20:36:14.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58442025-01-06T20:36:14.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58452025-01-06T20:36:14.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58462025-01-06T20:36:14.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58472025-01-06T20:36:14.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58482025-01-06T20:36:14.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58492025-01-06T20:36:14.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58502025-01-06T20:36:14.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58512025-01-06T20:36:14.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58522025-01-06T20:36:14.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
58532025-01-06T20:36:14.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58542025-01-06T20:36:14.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58552025-01-06T20:36:15.008ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
58562025-01-06T20:36:15.008ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.508075ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
58572025-01-06T20:36:15.018ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.14083ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58582025-01-06T20:36:15.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 04d49f22-16b5-412f-8506-894705131205 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58592025-01-06T20:36:15.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 04d49f22-16b5-412f-8506-894705131205 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58602025-01-06T20:36:15.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 04d49f22-16b5-412f-8506-894705131205 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58612025-01-06T20:36:16.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4664653e-5643-469a-8eca-5f6c61a32aed roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58622025-01-06T20:36:16.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4664653e-5643-469a-8eca-5f6c61a32aed resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58632025-01-06T20:36:16.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4664653e-5643-469a-8eca-5f6c61a32aed response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58642025-01-06T20:36:17.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cfe3b660-1b50-4889-887d-c6698e54fe84 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58652025-01-06T20:36:17.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cfe3b660-1b50-4889-887d-c6698e54fe84 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58662025-01-06T20:36:17.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cfe3b660-1b50-4889-887d-c6698e54fe84 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58672025-01-06T20:36:17.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = b6b32a71-753d-4a5c-ae96-226271aab5a8 roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
58682025-01-06T20:36:17.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = b6b32a71-753d-4a5c-ae96-226271aab5a8 resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
58692025-01-06T20:36:17.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = b6b32a71-753d-4a5c-ae96-226271aab5a8 response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
58702025-01-06T20:36:17.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 35712189-3c3d-4bd0-9c6b-3563d574a15f roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
58712025-01-06T20:36:17.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 35712189-3c3d-4bd0-9c6b-3563d574a15f resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
58722025-01-06T20:36:17.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 35712189-3c3d-4bd0-9c6b-3563d574a15f response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
58732025-01-06T20:36:17.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 445 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 6cd35e30-51a0-44dd-b19c-d2c7326870c8 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
58742025-01-06T20:36:18.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9c7a9861-aa5c-44c1-983e-10c1cf446908 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58752025-01-06T20:36:18.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9c7a9861-aa5c-44c1-983e-10c1cf446908 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58762025-01-06T20:36:18.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9c7a9861-aa5c-44c1-983e-10c1cf446908 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58772025-01-06T20:36:19.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a6bc5c28-6157-4634-89dd-b21265e27e8e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58782025-01-06T20:36:19.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a6bc5c28-6157-4634-89dd-b21265e27e8e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58792025-01-06T20:36:19.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1703 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a6bc5c28-6157-4634-89dd-b21265e27e8e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58802025-01-06T20:36:20.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a6e8bdb2-5ef4-41b0-94b0-d934caa04656 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58812025-01-06T20:36:20.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a6e8bdb2-5ef4-41b0-94b0-d934caa04656 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58822025-01-06T20:36:20.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a6e8bdb2-5ef4-41b0-94b0-d934caa04656 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58832025-01-06T20:36:21.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1e2a45e2-43cc-4dbd-98d9-518d2a09d04f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58842025-01-06T20:36:21.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1e2a45e2-43cc-4dbd-98d9-518d2a09d04f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58852025-01-06T20:36:21.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1e2a45e2-43cc-4dbd-98d9-518d2a09d04f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58862025-01-06T20:36:22.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 963371f0-caad-4cd9-8e15-f9e133a95756 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58872025-01-06T20:36:22.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 963371f0-caad-4cd9-8e15-f9e133a95756 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58882025-01-06T20:36:22.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 963371f0-caad-4cd9-8e15-f9e133a95756 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58892025-01-06T20:36:23.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3e4b462b-de23-453c-9735-9a4862a14c46 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58902025-01-06T20:36:23.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3e4b462b-de23-453c-9735-9a4862a14c46 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58912025-01-06T20:36:23.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3e4b462b-de23-453c-9735-9a4862a14c46 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58922025-01-06T20:36:24.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1ce45ff9-7dff-4f98-b43c-c63bb3c1949f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58932025-01-06T20:36:24.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1ce45ff9-7dff-4f98-b43c-c63bb3c1949f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58942025-01-06T20:36:24.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1ce45ff9-7dff-4f98-b43c-c63bb3c1949f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
58952025-01-06T20:36:24.987ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
58962025-01-06T20:36:24.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58972025-01-06T20:36:24.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58982025-01-06T20:36:24.987ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
58992025-01-06T20:36:24.987ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59002025-01-06T20:36:24.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59012025-01-06T20:36:24.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59022025-01-06T20:36:24.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59032025-01-06T20:36:24.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59042025-01-06T20:36:24.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59052025-01-06T20:36:24.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59062025-01-06T20:36:24.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59072025-01-06T20:36:24.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59082025-01-06T20:36:24.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
59092025-01-06T20:36:24.998ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59102025-01-06T20:36:24.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59112025-01-06T20:36:25.009ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
59122025-01-06T20:36:25.009ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.203144ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
59132025-01-06T20:36:25.017ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59142025-01-06T20:36:25.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59152025-01-06T20:36:25.046ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.324398ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59162025-01-06T20:36:25.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 577eb3aa-b8df-4f3d-aa48-53ba87d63527 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59172025-01-06T20:36:25.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 577eb3aa-b8df-4f3d-aa48-53ba87d63527 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59182025-01-06T20:36:25.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 577eb3aa-b8df-4f3d-aa48-53ba87d63527 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59192025-01-06T20:36:26.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5bdb922e-9b09-44da-baf0-e0c2e767f7df roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59202025-01-06T20:36:26.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5bdb922e-9b09-44da-baf0-e0c2e767f7df resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59212025-01-06T20:36:26.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2703 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5bdb922e-9b09-44da-baf0-e0c2e767f7df response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59222025-01-06T20:36:27.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 95a94e65-7d2f-404f-840e-966d3b71d759 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59232025-01-06T20:36:27.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 95a94e65-7d2f-404f-840e-966d3b71d759 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59242025-01-06T20:36:27.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 95a94e65-7d2f-404f-840e-966d3b71d759 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59252025-01-06T20:36:27.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 485 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 37d017d9-71fb-47e6-8706-3c543d33baae response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
59262025-01-06T20:36:28.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 38288073-18ee-4ce0-a39a-7eee71ad5684 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59272025-01-06T20:36:28.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 38288073-18ee-4ce0-a39a-7eee71ad5684 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59282025-01-06T20:36:28.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1748 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 38288073-18ee-4ce0-a39a-7eee71ad5684 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59292025-01-06T20:36:29.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 189d49d8-7711-4c34-9f1a-23afe3bc9363 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59302025-01-06T20:36:29.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 189d49d8-7711-4c34-9f1a-23afe3bc9363 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59312025-01-06T20:36:29.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 189d49d8-7711-4c34-9f1a-23afe3bc9363 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59322025-01-06T20:36:30.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0d7ef9f3-9800-4cbb-b0ba-8550a0893e0d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59332025-01-06T20:36:30.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0d7ef9f3-9800-4cbb-b0ba-8550a0893e0d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59342025-01-06T20:36:30.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0d7ef9f3-9800-4cbb-b0ba-8550a0893e0d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59352025-01-06T20:36:31.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9ace4d8d-85bc-48bd-8d2f-53f79bd12565 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59362025-01-06T20:36:31.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9ace4d8d-85bc-48bd-8d2f-53f79bd12565 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59372025-01-06T20:36:31.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9ace4d8d-85bc-48bd-8d2f-53f79bd12565 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59382025-01-06T20:36:32.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 33fef992-9f30-4b9b-a665-5d209aa60b24 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59392025-01-06T20:36:32.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 33fef992-9f30-4b9b-a665-5d209aa60b24 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59402025-01-06T20:36:32.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 33fef992-9f30-4b9b-a665-5d209aa60b24 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59412025-01-06T20:36:33.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 444bb37f-459e-4dc2-84ad-863351208c1d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59422025-01-06T20:36:33.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 444bb37f-459e-4dc2-84ad-863351208c1d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59432025-01-06T20:36:33.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1890 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 444bb37f-459e-4dc2-84ad-863351208c1d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59442025-01-06T20:36:34.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 70b1cd43-2bdd-4322-aa7e-db105f5f89a3 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59452025-01-06T20:36:34.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 70b1cd43-2bdd-4322-aa7e-db105f5f89a3 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59462025-01-06T20:36:34.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 70b1cd43-2bdd-4322-aa7e-db105f5f89a3 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
59472025-01-06T20:36:34.986ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
59482025-01-06T20:36:34.986ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
59492025-01-06T20:36:34.986ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
59502025-01-06T20:36:34.986ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59512025-01-06T20:36:34.986ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-06 20:26:34.986925770 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
59522025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
59532025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
59542025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59552025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
59562025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
59572025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
59582025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
59592025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59602025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
59612025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
59622025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
59632025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
59642025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59652025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
59662025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59672025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
59682025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59692025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
59702025-01-06T20:36:34.987ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468
59712025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.81\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468"}
59722025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
59732025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59742025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59752025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59762025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59772025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59782025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
59792025-01-06T20:36:34.987ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65bacdd1-9837-48ad-941c-aec5e2d79006.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1237, tv_nsec: 677347842 } })
59802025-01-06T20:36:34.987ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("88aaaee6-38b4-4a83-9c08-04f0ea18e003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8dd67555-06fb-4cef-b914-9650f0eeb68a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1237, tv_nsec: 677401383 } })
59812025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
59822025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59832025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
59842025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
59852025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
59862025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
59872025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59882025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59892025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
59902025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59912025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
59922025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59932025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
59942025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
59952025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
59962025-01-06T20:36:34.987ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
59972025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
59982025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
59992025-01-06T20:36:34.987ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
60002025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
60012025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
60022025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60032025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60042025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60052025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
60062025-01-06T20:36:34.988ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
60072025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
60082025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60092025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60102025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
60112025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
60122025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
60132025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60142025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60152025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60162025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60172025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
60182025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
60192025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
60202025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60212025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60222025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
60232025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
60242025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
60252025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
60262025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
60272025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
60282025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60292025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60302025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60312025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60322025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60332025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60342025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
60352025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
60362025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.705546ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
60372025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
60382025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.748117ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
60392025-01-06T20:36:34.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60402025-01-06T20:36:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60412025-01-06T20:36:34.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60422025-01-06T20:36:34.990ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1237, tv_nsec: 680449976 } })
60432025-01-06T20:36:34.991ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
60442025-01-06T20:36:34.991ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60452025-01-06T20:36:34.991ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1237, tv_nsec: 681398872 } })
60462025-01-06T20:36:34.991ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.77478ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60472025-01-06T20:36:34.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60482025-01-06T20:36:34.991ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
60492025-01-06T20:36:34.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60502025-01-06T20:36:34.992ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-06 20:26:34.986925770 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
60512025-01-06T20:36:34.992ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.805668ms iteration = 9 status = {"expiration":"2025-01-06T20:26:34.986925770Z","pruned":[]}
60522025-01-06T20:36:34.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60532025-01-06T20:36:34.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60542025-01-06T20:36:34.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60552025-01-06T20:36:34.994ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60562025-01-06T20:36:34.994ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60572025-01-06T20:36:34.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60582025-01-06T20:36:34.996ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.488462ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
60592025-01-06T20:36:34.996ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60602025-01-06T20:36:34.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60612025-01-06T20:36:34.998ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60622025-01-06T20:36:34.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60632025-01-06T20:36:35.003ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60642025-01-06T20:36:35.003ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
60652025-01-06T20:36:35.003ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60662025-01-06T20:36:35.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60672025-01-06T20:36:35.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60682025-01-06T20:36:35.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60692025-01-06T20:36:35.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60702025-01-06T20:36:35.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
60712025-01-06T20:36:35.010ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60722025-01-06T20:36:35.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 22.391809ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60732025-01-06T20:36:35.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60742025-01-06T20:36:35.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60752025-01-06T20:36:35.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60762025-01-06T20:36:35.021ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60772025-01-06T20:36:35.024ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60782025-01-06T20:36:35.024ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
60792025-01-06T20:36:35.024ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60802025-01-06T20:36:35.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60812025-01-06T20:36:35.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
60822025-01-06T20:36:35.026ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60832025-01-06T20:36:35.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60842025-01-06T20:36:35.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.053262ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
60852025-01-06T20:36:35.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60862025-01-06T20:36:35.059ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60872025-01-06T20:36:35.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60882025-01-06T20:36:35.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60892025-01-06T20:36:35.061ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60902025-01-06T20:36:35.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60912025-01-06T20:36:35.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60922025-01-06T20:36:35.062ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60932025-01-06T20:36:35.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60942025-01-06T20:36:35.063ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60952025-01-06T20:36:35.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.556154ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
60962025-01-06T20:36:35.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60972025-01-06T20:36:35.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60982025-01-06T20:36:35.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60992025-01-06T20:36:35.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61002025-01-06T20:36:35.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61012025-01-06T20:36:35.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
61022025-01-06T20:36:35.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61032025-01-06T20:36:35.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61042025-01-06T20:36:35.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61052025-01-06T20:36:35.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61062025-01-06T20:36:35.071ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61072025-01-06T20:36:35.071ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
61082025-01-06T20:36:35.071ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
61092025-01-06T20:36:35.071ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 83.098972ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
61102025-01-06T20:36:35.071ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61112025-01-06T20:36:35.071ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61122025-01-06T20:36:35.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61132025-01-06T20:36:35.072ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1237, tv_nsec: 761840762 } })
61142025-01-06T20:36:35.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61152025-01-06T20:36:35.072ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
61162025-01-06T20:36:35.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
61172025-01-06T20:36:35.074ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61182025-01-06T20:36:35.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61192025-01-06T20:36:35.078ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
61202025-01-06T20:36:35.078ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
61212025-01-06T20:36:35.078ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
61222025-01-06T20:36:35.078ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61232025-01-06T20:36:35.078ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61242025-01-06T20:36:35.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61252025-01-06T20:36:35.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
61262025-01-06T20:36:35.079ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61272025-01-06T20:36:35.079ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61282025-01-06T20:36:35.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61292025-01-06T20:36:35.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61302025-01-06T20:36:35.082ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61312025-01-06T20:36:35.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61322025-01-06T20:36:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.942387ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61332025-01-06T20:36:35.088ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61342025-01-06T20:36:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61352025-01-06T20:36:35.089ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61362025-01-06T20:36:35.089ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
61372025-01-06T20:36:35.089ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 101.344369ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
61382025-01-06T20:36:35.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61392025-01-06T20:36:35.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
61402025-01-06T20:36:35.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61412025-01-06T20:36:35.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61422025-01-06T20:36:35.116ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61432025-01-06T20:36:35.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61442025-01-06T20:36:35.124ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 136.704302ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61452025-01-06T20:36:35.130ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
61462025-01-06T20:36:35.130ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
61472025-01-06T20:36:35.130ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
61482025-01-06T20:36:35.130ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61492025-01-06T20:36:35.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61502025-01-06T20:36:35.136ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
61512025-01-06T20:36:35.139ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61522025-01-06T20:36:35.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61532025-01-06T20:36:35.145ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
61542025-01-06T20:36:35.145ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61552025-01-06T20:36:35.145ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c7846a9-15b2-491f-bcf9-aac7c712b7b4", "content-length": "26", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} })
61562025-01-06T20:36:35.145ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61572025-01-06T20:36:35.147ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61582025-01-06T20:36:35.151ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
61592025-01-06T20:36:35.151ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61602025-01-06T20:36:35.151ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "79cc7362-64cc-43d4-b2a1-9dc5d6a27b3e", "content-length": "26", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} })
61612025-01-06T20:36:35.151ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61622025-01-06T20:36:35.154ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61632025-01-06T20:36:35.176ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
61642025-01-06T20:36:35.207ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61652025-01-06T20:36:35.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61662025-01-06T20:36:35.234ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
61672025-01-06T20:36:35.234ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61682025-01-06T20:36:35.235ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f660f9d-7a50-46b4-8486-496fb5de9c22", "content-length": "26", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} })
61692025-01-06T20:36:35.235ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61702025-01-06T20:36:35.243ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
61712025-01-06T20:36:35.268ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
61722025-01-06T20:36:35.269ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61732025-01-06T20:36:35.269ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fc9ff54-621e-4dea-9e9b-94ad7786d755", "content-length": "372", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} })
61742025-01-06T20:36:35.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61752025-01-06T20:36:35.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61762025-01-06T20:36:35.285ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61772025-01-06T20:36:35.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61782025-01-06T20:36:35.288ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61792025-01-06T20:36:35.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61802025-01-06T20:36:35.289ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61812025-01-06T20:36:35.290ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61822025-01-06T20:36:35.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61832025-01-06T20:36:35.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
61842025-01-06T20:36:35.295ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61852025-01-06T20:36:35.295ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61862025-01-06T20:36:35.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61872025-01-06T20:36:35.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61882025-01-06T20:36:35.298ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 310.40234ms iteration = 17 status = 0
61892025-01-06T20:36:35.301ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
61902025-01-06T20:36:35.301ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 314.146482ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
61912025-01-06T20:36:35.309ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
61922025-01-06T20:36:35.310ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "202c7b80-653e-4d23-948e-c5af8cd1e14f", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61932025-01-06T20:36:35.310ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61942025-01-06T20:36:35.321ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "310a38eb-6772-4159-8c26-7aecc846d712", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61952025-01-06T20:36:35.321ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61962025-01-06T20:36:35.323ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
61972025-01-06T20:36:35.323ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 335.997757ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
61982025-01-06T20:36:35.333ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61992025-01-06T20:36:35.334ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62002025-01-06T20:36:35.336ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
62012025-01-06T20:36:35.336ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
62022025-01-06T20:36:35.336ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 348.788194ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
62032025-01-06T20:36:35.337ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62042025-01-06T20:36:35.337ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62052025-01-06T20:36:35.338ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62062025-01-06T20:36:35.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62072025-01-06T20:36:35.338ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62082025-01-06T20:36:35.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62092025-01-06T20:36:35.345ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62102025-01-06T20:36:35.345ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62112025-01-06T20:36:35.345ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62122025-01-06T20:36:35.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62132025-01-06T20:36:35.349ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62142025-01-06T20:36:35.349ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62152025-01-06T20:36:35.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62162025-01-06T20:36:35.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62172025-01-06T20:36:35.349ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62182025-01-06T20:36:35.349ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62192025-01-06T20:36:35.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62202025-01-06T20:36:35.352ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62212025-01-06T20:36:35.352ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "526b0e9d-a396-4cfe-9a27-1d869045e148", "content-length": "1", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} })
62222025-01-06T20:36:35.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62232025-01-06T20:36:35.354ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62242025-01-06T20:36:35.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62252025-01-06T20:36:35.355ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62262025-01-06T20:36:35.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62272025-01-06T20:36:35.361ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
62282025-01-06T20:36:35.361ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 372.88406ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
62292025-01-06T20:36:35.363ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 376.846528ms iteration = 17 status = null
62302025-01-06T20:36:35.371ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 384.373383ms iteration = 17 status = {}
62312025-01-06T20:36:35.378ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
62322025-01-06T20:36:35.378ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
62332025-01-06T20:36:35.378ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "14942993-5111-436a-a982-9238fe76912e", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} })
62342025-01-06T20:36:35.378ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62352025-01-06T20:36:35.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62362025-01-06T20:36:35.382ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
62372025-01-06T20:36:35.382ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62382025-01-06T20:36:35.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62392025-01-06T20:36:35.385ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62402025-01-06T20:36:35.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62412025-01-06T20:36:35.390ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62422025-01-06T20:36:35.390ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62432025-01-06T20:36:35.391ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ae8900f7-6c8c-4201-814b-3f40e971ce6c", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} })
62442025-01-06T20:36:35.393ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
62452025-01-06T20:36:35.393ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 0 version = 2
62462025-01-06T20:36:35.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62472025-01-06T20:36:35.394ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 405.999041ms iteration = 17 status = {}
62482025-01-06T20:36:35.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62492025-01-06T20:36:35.401ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 413.28803ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
62502025-01-06T20:36:35.411ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
62512025-01-06T20:36:35.411ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
62522025-01-06T20:36:35.411ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62532025-01-06T20:36:35.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62542025-01-06T20:36:35.415ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62552025-01-06T20:36:35.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62562025-01-06T20:36:35.418ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62572025-01-06T20:36:35.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62582025-01-06T20:36:35.421ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-06T20:28:32.843602Z, time_modified: 2025-01-06T20:28:32.843602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }) }
62592025-01-06T20:36:35.421ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 434.076385ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]}},"default_endpoint":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
62602025-01-06T20:36:35.423ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
62612025-01-06T20:36:35.423ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
62622025-01-06T20:36:35.423ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-06 20:28:35.848690 UTC dns_group = internal generation = 1
62632025-01-06T20:36:35.423ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 436.290806ms iteration = 9 status = {"generation":1}
62642025-01-06T20:36:35.448ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62652025-01-06T20:36:35.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62662025-01-06T20:36:35.452ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62672025-01-06T20:36:35.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62682025-01-06T20:36:35.455ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 1 version = 2
62692025-01-06T20:36:35.455ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
62702025-01-06T20:36:35.455ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-06 20:28:37.181288 UTC dns_group = external generation = 2
62712025-01-06T20:36:35.455ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 468.278246ms iteration = 9 status = {"generation":2}
62722025-01-06T20:36:35.470ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
62732025-01-06T20:36:35.470ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 482.608737ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
62742025-01-06T20:36:35.470ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 482.582036ms iteration = 19 status = {"physical_disks_added":0}
62752025-01-06T20:36:35.479ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
62762025-01-06T20:36:35.480ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "dd0203b2-2209-4a06-b7d4-1f392b5df0a6", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
62772025-01-06T20:36:35.480ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
62782025-01-06T20:36:35.482ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3c59edaf-5a2f-445c-8bf3-425ab0a6a92a", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
62792025-01-06T20:36:35.482ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
62802025-01-06T20:36:35.485ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5e3f2b16-b4dc-41ff-8350-fce37aa6eab4", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
62812025-01-06T20:36:35.485ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
62822025-01-06T20:36:35.488ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
62832025-01-06T20:36:35.488ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 501.199433ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
62842025-01-06T20:36:35.530ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62852025-01-06T20:36:35.531ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "24368077-1b77-46ab-ad9f-cf6592b7c1c9", "content-length": "691", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} })
62862025-01-06T20:36:35.531ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
62872025-01-06T20:36:35.531ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
62882025-01-06T20:36:35.531ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
62892025-01-06T20:36:35.533ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 546.009743ms iteration = 17 status = {}
62902025-01-06T20:36:35.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62912025-01-06T20:36:35.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62922025-01-06T20:36:35.541ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
62932025-01-06T20:36:35.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62942025-01-06T20:36:35.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62952025-01-06T20:36:35.553ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
62962025-01-06T20:36:35.553ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "294761dc-9294-4473-b8a2-08e13b01de78", "content-length": "134", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} })
62972025-01-06T20:36:35.553ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
62982025-01-06T20:36:35.553ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
62992025-01-06T20:36:35.554ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
63002025-01-06T20:36:35.554ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63012025-01-06T20:36:35.554ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63022025-01-06T20:36:35.554ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63032025-01-06T20:36:35.554ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63042025-01-06T20:36:35.554ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63052025-01-06T20:36:35.554ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63062025-01-06T20:36:35.554ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63072025-01-06T20:36:35.554ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
63082025-01-06T20:36:35.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63092025-01-06T20:36:35.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63102025-01-06T20:36:35.556ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63112025-01-06T20:36:35.557ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "04bffc2d-e4c8-4297-ab8b-9c70ac2613f4", "content-length": "2", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} })
63122025-01-06T20:36:35.557ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63132025-01-06T20:36:35.557ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f01eb0f2-d150-44bd-b105-a54feba7d855", "content-length": "52", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} })
63142025-01-06T20:36:35.557ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
63152025-01-06T20:36:35.557ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63162025-01-06T20:36:35.682ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "da3b1be9-a312-4391-b78f-63f1978d4e6a", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} })
63172025-01-06T20:36:35.682ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
63182025-01-06T20:36:35.682ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63192025-01-06T20:36:35.683ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "33f79fc0-9d87-49ad-bb73-4495cbb95148", "content-length": "682", "date": "Mon, 06 Jan 2025 20:36:35 GMT"} })
63202025-01-06T20:36:35.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63212025-01-06T20:36:35.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63222025-01-06T20:36:35.688ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63232025-01-06T20:36:35.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63242025-01-06T20:36:35.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63252025-01-06T20:36:35.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63262025-01-06T20:36:35.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63272025-01-06T20:36:35.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63282025-01-06T20:36:35.705ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 718.066366ms iteration = 17 status = {}
63292025-01-06T20:36:35.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1a96093c-3e9d-4ebc-920b-edf4f60df939 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63302025-01-06T20:36:35.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1a96093c-3e9d-4ebc-920b-edf4f60df939 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63312025-01-06T20:36:35.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1a96093c-3e9d-4ebc-920b-edf4f60df939 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63322025-01-06T20:36:36.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d51222ff-a4e0-4eb2-8c51-89047c6dd7c3 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63332025-01-06T20:36:36.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d51222ff-a4e0-4eb2-8c51-89047c6dd7c3 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63342025-01-06T20:36:36.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2586 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d51222ff-a4e0-4eb2-8c51-89047c6dd7c3 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63352025-01-06T20:36:37.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 470 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = d61b8ed8-a0b3-4f84-a096-aa6d7951181d response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
63362025-01-06T20:36:37.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3e5170b5-d3d9-4818-811f-8bbcfa3c2ae9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63372025-01-06T20:36:37.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3e5170b5-d3d9-4818-811f-8bbcfa3c2ae9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63382025-01-06T20:36:37.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3e5170b5-d3d9-4818-811f-8bbcfa3c2ae9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63392025-01-06T20:36:38.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 50f56124-f026-40e7-9c18-b09cf0210742 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63402025-01-06T20:36:38.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 50f56124-f026-40e7-9c18-b09cf0210742 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63412025-01-06T20:36:38.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 50f56124-f026-40e7-9c18-b09cf0210742 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63422025-01-06T20:36:39.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c75e22bf-96da-48a0-a937-fa3be6f33ba7 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63432025-01-06T20:36:39.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c75e22bf-96da-48a0-a937-fa3be6f33ba7 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63442025-01-06T20:36:39.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2742 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c75e22bf-96da-48a0-a937-fa3be6f33ba7 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63452025-01-06T20:36:41.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1a071d5a-8d52-4a51-978e-bd354aafae7b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63462025-01-06T20:36:41.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1a071d5a-8d52-4a51-978e-bd354aafae7b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63472025-01-06T20:36:41.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1a071d5a-8d52-4a51-978e-bd354aafae7b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63482025-01-06T20:36:42.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6a473e6e-ac96-4436-8a4f-7e288ae37cf8 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63492025-01-06T20:36:42.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6a473e6e-ac96-4436-8a4f-7e288ae37cf8 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63502025-01-06T20:36:42.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6a473e6e-ac96-4436-8a4f-7e288ae37cf8 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63512025-01-06T20:36:43.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b2e4bdf4-ae1c-4b99-b5d5-366ed42a635c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63522025-01-06T20:36:43.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b2e4bdf4-ae1c-4b99-b5d5-366ed42a635c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63532025-01-06T20:36:43.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b2e4bdf4-ae1c-4b99-b5d5-366ed42a635c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63542025-01-06T20:36:44.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e55cad33-cbf7-4f04-8579-a3b3f6bf3a92 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63552025-01-06T20:36:44.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e55cad33-cbf7-4f04-8579-a3b3f6bf3a92 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63562025-01-06T20:36:44.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1651 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e55cad33-cbf7-4f04-8579-a3b3f6bf3a92 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63572025-01-06T20:36:44.987ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
63582025-01-06T20:36:44.987ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63592025-01-06T20:36:44.987ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
63602025-01-06T20:36:44.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63612025-01-06T20:36:44.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63622025-01-06T20:36:44.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63632025-01-06T20:36:44.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63642025-01-06T20:36:44.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63652025-01-06T20:36:44.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63662025-01-06T20:36:44.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63672025-01-06T20:36:44.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63682025-01-06T20:36:44.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63692025-01-06T20:36:44.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63702025-01-06T20:36:44.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
63712025-01-06T20:36:44.998ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63722025-01-06T20:36:44.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63732025-01-06T20:36:45.009ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
63742025-01-06T20:36:45.009ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.696811ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
63752025-01-06T20:36:45.017ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63762025-01-06T20:36:45.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63772025-01-06T20:36:45.051ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.018042ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63782025-01-06T20:36:45.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d60b17fd-bbb0-4b5f-8e81-aa9385ab127a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63792025-01-06T20:36:45.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d60b17fd-bbb0-4b5f-8e81-aa9385ab127a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63802025-01-06T20:36:45.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d60b17fd-bbb0-4b5f-8e81-aa9385ab127a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63812025-01-06T20:36:46.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e08fc3fc-4db2-46b5-82f5-95201e19a67a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63822025-01-06T20:36:46.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e08fc3fc-4db2-46b5-82f5-95201e19a67a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63832025-01-06T20:36:46.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e08fc3fc-4db2-46b5-82f5-95201e19a67a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63842025-01-06T20:36:47.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7279fbb3-334e-4910-9eb2-33428a3f8913 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63852025-01-06T20:36:47.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7279fbb3-334e-4910-9eb2-33428a3f8913 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63862025-01-06T20:36:47.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7279fbb3-334e-4910-9eb2-33428a3f8913 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63872025-01-06T20:36:47.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 478 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = a192d306-0638-4c3b-9876-13dbc23ddcc7 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
63882025-01-06T20:36:48.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1bb0d3cd-8ed7-4cb3-89a6-0e381fcfd978 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63892025-01-06T20:36:48.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1bb0d3cd-8ed7-4cb3-89a6-0e381fcfd978 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63902025-01-06T20:36:48.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1bb0d3cd-8ed7-4cb3-89a6-0e381fcfd978 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63912025-01-06T20:36:49.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8a386ecb-5964-4ff3-9c3a-c7f99d525d76 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63922025-01-06T20:36:49.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8a386ecb-5964-4ff3-9c3a-c7f99d525d76 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63932025-01-06T20:36:49.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8a386ecb-5964-4ff3-9c3a-c7f99d525d76 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63942025-01-06T20:36:50.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 518782cb-1453-4256-a32a-b43958d7a36e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63952025-01-06T20:36:50.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 518782cb-1453-4256-a32a-b43958d7a36e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63962025-01-06T20:36:50.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 518782cb-1453-4256-a32a-b43958d7a36e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63972025-01-06T20:36:51.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 856b9f89-2465-48ad-8ba8-59bbfc7648b9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63982025-01-06T20:36:51.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 856b9f89-2465-48ad-8ba8-59bbfc7648b9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
63992025-01-06T20:36:51.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 856b9f89-2465-48ad-8ba8-59bbfc7648b9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64002025-01-06T20:36:52.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3f789569-5db0-4755-88cf-8396957708f3 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64012025-01-06T20:36:52.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3f789569-5db0-4755-88cf-8396957708f3 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64022025-01-06T20:36:52.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3f789569-5db0-4755-88cf-8396957708f3 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64032025-01-06T20:36:53.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5d6b3402-51d2-4838-bbfc-c7953865a307 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64042025-01-06T20:36:53.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5d6b3402-51d2-4838-bbfc-c7953865a307 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64052025-01-06T20:36:53.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5d6b3402-51d2-4838-bbfc-c7953865a307 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64062025-01-06T20:36:54.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 77a24d1f-9372-4b49-9c1a-c305f7cd842a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64072025-01-06T20:36:54.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 77a24d1f-9372-4b49-9c1a-c305f7cd842a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64082025-01-06T20:36:54.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 77a24d1f-9372-4b49-9c1a-c305f7cd842a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64092025-01-06T20:36:54.986ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
64102025-01-06T20:36:54.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64112025-01-06T20:36:54.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64122025-01-06T20:36:54.987ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
64132025-01-06T20:36:54.987ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64142025-01-06T20:36:54.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64152025-01-06T20:36:54.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64162025-01-06T20:36:54.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64172025-01-06T20:36:54.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64182025-01-06T20:36:54.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64192025-01-06T20:36:54.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64202025-01-06T20:36:54.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64212025-01-06T20:36:54.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64222025-01-06T20:36:54.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
64232025-01-06T20:36:54.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64242025-01-06T20:36:54.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64252025-01-06T20:36:55.010ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
64262025-01-06T20:36:55.010ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.207581ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
64272025-01-06T20:36:55.015ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64282025-01-06T20:36:55.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64292025-01-06T20:36:55.044ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.610461ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64302025-01-06T20:36:55.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5478a8d4-cf91-46fe-9df4-2580734d8e5d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64312025-01-06T20:36:55.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5478a8d4-cf91-46fe-9df4-2580734d8e5d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64322025-01-06T20:36:55.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5478a8d4-cf91-46fe-9df4-2580734d8e5d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64332025-01-06T20:36:56.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5ee6f40a-39ac-42a3-81a6-541a6cd1a6fe roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64342025-01-06T20:36:56.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5ee6f40a-39ac-42a3-81a6-541a6cd1a6fe resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64352025-01-06T20:36:56.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5ee6f40a-39ac-42a3-81a6-541a6cd1a6fe response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64362025-01-06T20:36:57.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d6c51f0d-7f79-4853-b48c-490c18ddbd54 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64372025-01-06T20:36:57.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d6c51f0d-7f79-4853-b48c-490c18ddbd54 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64382025-01-06T20:36:57.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1744 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d6c51f0d-7f79-4853-b48c-490c18ddbd54 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64392025-01-06T20:36:57.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 480 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = db0d3300-68d4-4570-ba21-68bf030f0ab9 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
64402025-01-06T20:36:58.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4f6e4b2c-d8bb-4a7f-9650-6ca7c0030473 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64412025-01-06T20:36:58.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4f6e4b2c-d8bb-4a7f-9650-6ca7c0030473 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64422025-01-06T20:36:58.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4f6e4b2c-d8bb-4a7f-9650-6ca7c0030473 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64432025-01-06T20:36:59.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eb7d7481-7026-4278-ad9a-d216da0fba6f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64442025-01-06T20:36:59.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eb7d7481-7026-4278-ad9a-d216da0fba6f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64452025-01-06T20:36:59.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eb7d7481-7026-4278-ad9a-d216da0fba6f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64462025-01-06T20:37:00.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 037a4ff7-4aba-4e01-9349-57a9af2f007b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64472025-01-06T20:37:00.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 037a4ff7-4aba-4e01-9349-57a9af2f007b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64482025-01-06T20:37:00.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 037a4ff7-4aba-4e01-9349-57a9af2f007b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64492025-01-06T20:37:01.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 13e777dc-ebe4-4891-8478-230711501e9f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64502025-01-06T20:37:01.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 13e777dc-ebe4-4891-8478-230711501e9f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64512025-01-06T20:37:01.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 13e777dc-ebe4-4891-8478-230711501e9f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64522025-01-06T20:37:02.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9d6334a7-730a-479a-a99c-4c5ac96ba417 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64532025-01-06T20:37:02.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9d6334a7-730a-479a-a99c-4c5ac96ba417 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64542025-01-06T20:37:02.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9d6334a7-730a-479a-a99c-4c5ac96ba417 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64552025-01-06T20:37:02.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 3928e2a5-a441-4347-8dee-3db28dc790b1 roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
64562025-01-06T20:37:02.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 3928e2a5-a441-4347-8dee-3db28dc790b1 resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
64572025-01-06T20:37:02.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2734 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 3928e2a5-a441-4347-8dee-3db28dc790b1 response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
64582025-01-06T20:37:02.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 626f5760-a01f-423e-8aaf-376f76b23b0e roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
64592025-01-06T20:37:02.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 626f5760-a01f-423e-8aaf-376f76b23b0e resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
64602025-01-06T20:37:02.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 626f5760-a01f-423e-8aaf-376f76b23b0e response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
64612025-01-06T20:37:03.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 123fe278-3293-488b-b018-7097cbfcbe2a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64622025-01-06T20:37:03.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 123fe278-3293-488b-b018-7097cbfcbe2a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64632025-01-06T20:37:03.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2832 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 123fe278-3293-488b-b018-7097cbfcbe2a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64642025-01-06T20:37:04.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 22b2d0aa-9c0e-43eb-ad62-89acee70a395 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64652025-01-06T20:37:04.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 22b2d0aa-9c0e-43eb-ad62-89acee70a395 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64662025-01-06T20:37:04.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 22b2d0aa-9c0e-43eb-ad62-89acee70a395 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
64672025-01-06T20:37:04.986ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
64682025-01-06T20:37:04.986ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
64692025-01-06T20:37:04.986ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
64702025-01-06T20:37:04.986ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
64712025-01-06T20:37:04.986ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
64722025-01-06T20:37:04.986ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64732025-01-06T20:37:04.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64742025-01-06T20:37:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
64752025-01-06T20:37:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64762025-01-06T20:37:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64772025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
64782025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64792025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
64802025-01-06T20:37:04.988ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
64812025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
64822025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64832025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
64842025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
64852025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64862025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
64872025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
64882025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64892025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
64902025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64912025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
64922025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64932025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
64942025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64952025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
64962025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
64972025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
64982025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64992025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
65002025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
65012025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65022025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65032025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
65042025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65052025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65062025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65072025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65082025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65092025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65102025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65112025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65122025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65132025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65142025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65152025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65162025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65172025-01-06T20:37:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65182025-01-06T20:37:04.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65192025-01-06T20:37:04.989ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1267, tv_nsec: 679709926 } })
65202025-01-06T20:37:04.990ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
65212025-01-06T20:37:04.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65222025-01-06T20:37:04.990ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1267, tv_nsec: 680234430 } })
65232025-01-06T20:37:04.990ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
65242025-01-06T20:37:04.990ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65252025-01-06T20:37:04.990ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.103742ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
65262025-01-06T20:37:04.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65272025-01-06T20:37:04.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65282025-01-06T20:37:04.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65292025-01-06T20:37:04.992ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65302025-01-06T20:37:04.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65312025-01-06T20:37:04.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65322025-01-06T20:37:04.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65332025-01-06T20:37:04.993ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65342025-01-06T20:37:04.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65352025-01-06T20:37:05.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65362025-01-06T20:37:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65372025-01-06T20:37:05.001ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1267, tv_nsec: 691254500 } })
65382025-01-06T20:37:05.001ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65392025-01-06T20:37:05.001ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
65402025-01-06T20:37:05.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65412025-01-06T20:37:05.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65422025-01-06T20:37:05.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65432025-01-06T20:37:05.048ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65442025-01-06T20:37:05.048ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
65452025-01-06T20:37:05.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65462025-01-06T20:37:05.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65472025-01-06T20:37:05.051ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65482025-01-06T20:37:05.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65492025-01-06T20:37:05.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65502025-01-06T20:37:05.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.738352ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
65512025-01-06T20:37:05.055ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65522025-01-06T20:37:05.055ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65532025-01-06T20:37:05.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65542025-01-06T20:37:05.055ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65552025-01-06T20:37:05.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65562025-01-06T20:37:05.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65572025-01-06T20:37:05.056ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.091923ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
65582025-01-06T20:37:05.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65592025-01-06T20:37:05.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
65602025-01-06T20:37:05.057ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65612025-01-06T20:37:05.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65622025-01-06T20:37:05.058ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65632025-01-06T20:37:05.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65642025-01-06T20:37:05.059ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65652025-01-06T20:37:05.060ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65662025-01-06T20:37:05.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65672025-01-06T20:37:05.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65682025-01-06T20:37:05.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
65692025-01-06T20:37:05.062ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65702025-01-06T20:37:05.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65712025-01-06T20:37:05.063ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65722025-01-06T20:37:05.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65732025-01-06T20:37:05.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65742025-01-06T20:37:05.065ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65752025-01-06T20:37:05.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65762025-01-06T20:37:05.065ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65772025-01-06T20:37:05.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65782025-01-06T20:37:05.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
65792025-01-06T20:37:05.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65802025-01-06T20:37:05.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65812025-01-06T20:37:05.068ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
65822025-01-06T20:37:05.068ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65832025-01-06T20:37:05.068ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a36efa0-e9c1-4a74-a2db-a07a1e59e054", "content-length": "26", "date": "Mon, 06 Jan 2025 20:37:05 GMT"} })
65842025-01-06T20:37:05.068ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65852025-01-06T20:37:05.069ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65862025-01-06T20:37:05.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65872025-01-06T20:37:05.070ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65882025-01-06T20:37:05.074ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
65892025-01-06T20:37:05.074ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65902025-01-06T20:37:05.075ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "457f0a84-5b3a-4a54-8c58-e6bc2c5dbb59", "content-length": "26", "date": "Mon, 06 Jan 2025 20:37:05 GMT"} })
65912025-01-06T20:37:05.075ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65922025-01-06T20:37:05.076ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65932025-01-06T20:37:05.081ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
65942025-01-06T20:37:05.081ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.621066ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
65952025-01-06T20:37:05.083ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65962025-01-06T20:37:05.083ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
65972025-01-06T20:37:05.083ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65982025-01-06T20:37:05.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65992025-01-06T20:37:05.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.107055ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66002025-01-06T20:37:05.092ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66012025-01-06T20:37:05.092ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66022025-01-06T20:37:05.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66032025-01-06T20:37:05.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66042025-01-06T20:37:05.100ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66052025-01-06T20:37:05.100ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 112.178463ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66062025-01-06T20:37:05.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66072025-01-06T20:37:05.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 116.165052ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66082025-01-06T20:37:05.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66092025-01-06T20:37:05.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 116.381797ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66102025-01-06T20:37:05.106ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66112025-01-06T20:37:05.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
66122025-01-06T20:37:05.109ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66132025-01-06T20:37:05.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66142025-01-06T20:37:05.111ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 123.480882ms iteration = 18 status = 0
66152025-01-06T20:37:05.115ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
66162025-01-06T20:37:05.115ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66172025-01-06T20:37:05.119ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "37de376c-0d5e-4a5a-8089-26db55aaf6a2", "content-length": "26", "date": "Mon, 06 Jan 2025 20:37:05 GMT"} })
66182025-01-06T20:37:05.119ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66192025-01-06T20:37:05.120ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
66202025-01-06T20:37:05.135ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 147.290229ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
66212025-01-06T20:37:05.136ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66222025-01-06T20:37:05.136ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
66232025-01-06T20:37:05.136ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 147.780493ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
66242025-01-06T20:37:05.144ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
66252025-01-06T20:37:05.144ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "be2bf756-e13e-4452-8d68-fa503f074242", "content-length": "1", "date": "Mon, 06 Jan 2025 20:37:04 GMT"} })
66262025-01-06T20:37:05.146ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66272025-01-06T20:37:05.146ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 159.881512ms iteration = 18 status = {}
66282025-01-06T20:37:05.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66292025-01-06T20:37:05.178ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 189.821497ms iteration = 20 status = {"physical_disks_added":0}
66302025-01-06T20:37:05.188ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66312025-01-06T20:37:05.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66322025-01-06T20:37:05.212ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
66332025-01-06T20:37:05.212ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66342025-01-06T20:37:05.212ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4822f95-f111-42ef-852f-059d47726ea7", "content-length": "372", "date": "Mon, 06 Jan 2025 20:37:05 GMT"} })
66352025-01-06T20:37:05.212ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66362025-01-06T20:37:05.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66372025-01-06T20:37:05.214ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 227.843733ms iteration = 18 status = null
66382025-01-06T20:37:05.217ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66392025-01-06T20:37:05.220ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66402025-01-06T20:37:05.220ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66412025-01-06T20:37:05.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66422025-01-06T20:37:05.222ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66432025-01-06T20:37:05.224ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66442025-01-06T20:37:05.224ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66452025-01-06T20:37:05.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66462025-01-06T20:37:05.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66472025-01-06T20:37:05.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66482025-01-06T20:37:05.282ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
66492025-01-06T20:37:05.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66502025-01-06T20:37:05.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66512025-01-06T20:37:05.290ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
66522025-01-06T20:37:05.290ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
66532025-01-06T20:37:05.290ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8b46ee1a-6f0b-4093-a704-11d5d59c8344", "date": "Mon, 06 Jan 2025 20:37:05 GMT"} })
66542025-01-06T20:37:05.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66552025-01-06T20:37:05.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66562025-01-06T20:37:05.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66572025-01-06T20:37:05.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66582025-01-06T20:37:05.293ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
66592025-01-06T20:37:05.293ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d3b8562-38a6-446f-8b0b-da84ef8a8779", "content-length": "134", "date": "Mon, 06 Jan 2025 20:37:04 GMT"} })
66602025-01-06T20:37:05.293ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
66612025-01-06T20:37:05.293ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
66622025-01-06T20:37:05.293ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
66632025-01-06T20:37:05.293ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
66642025-01-06T20:37:05.293ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66652025-01-06T20:37:05.293ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66662025-01-06T20:37:05.293ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66672025-01-06T20:37:05.293ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
66682025-01-06T20:37:05.294ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66692025-01-06T20:37:05.294ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
66702025-01-06T20:37:05.294ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
66712025-01-06T20:37:05.294ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66722025-01-06T20:37:05.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66732025-01-06T20:37:05.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66742025-01-06T20:37:05.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66752025-01-06T20:37:05.297ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
66762025-01-06T20:37:05.297ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac8633f5-657d-433b-8b08-95fae7a16121", "content-length": "2", "date": "Mon, 06 Jan 2025 20:37:04 GMT"} })
66772025-01-06T20:37:05.297ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
66782025-01-06T20:37:05.297ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5af8283-bf2a-4023-a4cd-8d50cb096028", "content-length": "52", "date": "Mon, 06 Jan 2025 20:37:04 GMT"} })
66792025-01-06T20:37:05.297ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
66802025-01-06T20:37:05.297ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
66812025-01-06T20:37:05.299ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
66822025-01-06T20:37:05.299ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66832025-01-06T20:37:05.331ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
66842025-01-06T20:37:05.404ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ae8f7e35-849b-455c-a441-e11ead6c99f0", "date": "Mon, 06 Jan 2025 20:37:05 GMT"} })
66852025-01-06T20:37:05.404ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
66862025-01-06T20:37:05.404ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
66872025-01-06T20:37:05.405ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "55129bcc-376c-46c3-8f79-0789006de97a", "content-length": "682", "date": "Mon, 06 Jan 2025 20:37:05 GMT"} })
66882025-01-06T20:37:05.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66892025-01-06T20:37:05.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66902025-01-06T20:37:05.406ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "23d5b532-6b32-4ec7-a36f-47be8ae39295", "content-length": "691", "date": "Mon, 06 Jan 2025 20:37:05 GMT"} })
66912025-01-06T20:37:05.406ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
66922025-01-06T20:37:05.406ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
66932025-01-06T20:37:05.406ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
66942025-01-06T20:37:05.407ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 419.096568ms iteration = 18 status = {}
66952025-01-06T20:37:05.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66962025-01-06T20:37:05.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66972025-01-06T20:37:05.411ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f4ea308e-4ae7-41ec-a564-7e75e3157f09", "date": "Mon, 06 Jan 2025 20:37:05 GMT"} })
66982025-01-06T20:37:05.412ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 424.319911ms iteration = 18 status = {}
66992025-01-06T20:37:05.413ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67002025-01-06T20:37:05.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67012025-01-06T20:37:05.415ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67022025-01-06T20:37:05.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67032025-01-06T20:37:05.422ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 434.363424ms iteration = 18 status = {}
67042025-01-06T20:37:05.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7e16b3e8-2712-43bb-836c-054af87800ef roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67052025-01-06T20:37:05.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7e16b3e8-2712-43bb-836c-054af87800ef resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67062025-01-06T20:37:05.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7e16b3e8-2712-43bb-836c-054af87800ef response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67072025-01-06T20:37:05.680ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
67082025-01-06T20:37:05.680ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
67092025-01-06T20:37:05.710ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
67102025-01-06T20:37:05.710ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:61354
67112025-01-06T20:37:05.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61354 req_id = 9de3f965-0efd-49fc-ade3-c807397d9564 roles = RoleSet { roles: {} } uri = /metrics/producers
67122025-01-06T20:37:05.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61354 req_id = 9de3f965-0efd-49fc-ade3-c807397d9564 resource = Database result = Ok(()) uri = /metrics/producers
67132025-01-06T20:37:05.748ZINFOnexus: assigned collector to new producer collector_id = 3aa155a2-91f9-44a1-9f26-4a40e0aef546 file = nexus/src/app/oximeter.rs:76 producer_id = d4581482-c7a8-479c-a435-cf6d95b38f96
67142025-01-06T20:37:05.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37853 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61354 req_id = 9de3f965-0efd-49fc-ade3-c807397d9564 response_code = 201 uri = /metrics/producers
67152025-01-06T20:37:05.748ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "9de3f965-0efd-49fc-ade3-c807397d9564", "content-length": "41", "date": "Mon, 06 Jan 2025 20:37:05 GMT"} })
67162025-01-06T20:37:05.749ZDEBGnexus (producer-registration-task): registered with nexus successfully
67172025-01-06T20:37:05.749ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
67182025-01-06T20:37:06.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3ad44c48-eaae-4925-8424-931f49f54ea4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67192025-01-06T20:37:06.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3ad44c48-eaae-4925-8424-931f49f54ea4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67202025-01-06T20:37:06.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3ad44c48-eaae-4925-8424-931f49f54ea4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67212025-01-06T20:37:07.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = df8a86a8-7b36-4537-81e0-9db8321a30ee roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67222025-01-06T20:37:07.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = df8a86a8-7b36-4537-81e0-9db8321a30ee resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67232025-01-06T20:37:07.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = df8a86a8-7b36-4537-81e0-9db8321a30ee response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67242025-01-06T20:37:07.760ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 564 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = e383b2d2-49ae-452d-9830-a39b71ace0d0 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
67252025-01-06T20:37:08.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bcf521f5-139a-4cb5-b64d-960fe6ce20e2 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67262025-01-06T20:37:08.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bcf521f5-139a-4cb5-b64d-960fe6ce20e2 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67272025-01-06T20:37:08.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bcf521f5-139a-4cb5-b64d-960fe6ce20e2 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67282025-01-06T20:37:09.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bf2979bb-21dd-4ccd-88a3-c2012ef5d3cd roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67292025-01-06T20:37:09.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bf2979bb-21dd-4ccd-88a3-c2012ef5d3cd resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67302025-01-06T20:37:09.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3709 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bf2979bb-21dd-4ccd-88a3-c2012ef5d3cd response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67312025-01-06T20:37:10.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 391ca405-d1e1-41f8-bbf5-7f614a54012b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67322025-01-06T20:37:10.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 391ca405-d1e1-41f8-bbf5-7f614a54012b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67332025-01-06T20:37:10.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 391ca405-d1e1-41f8-bbf5-7f614a54012b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67342025-01-06T20:37:11.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4857b310-b81b-43f0-9caf-0dbfaeb1a47c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67352025-01-06T20:37:11.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4857b310-b81b-43f0-9caf-0dbfaeb1a47c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67362025-01-06T20:37:11.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4857b310-b81b-43f0-9caf-0dbfaeb1a47c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67372025-01-06T20:37:12.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7266e87d-1d88-4dc3-b26f-5339d640e070 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67382025-01-06T20:37:12.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7266e87d-1d88-4dc3-b26f-5339d640e070 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67392025-01-06T20:37:12.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7266e87d-1d88-4dc3-b26f-5339d640e070 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67402025-01-06T20:37:13.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6f9ef06b-b794-4f7c-8682-a10729a3aca4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67412025-01-06T20:37:13.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6f9ef06b-b794-4f7c-8682-a10729a3aca4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67422025-01-06T20:37:13.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6f9ef06b-b794-4f7c-8682-a10729a3aca4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67432025-01-06T20:37:14.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 99ef7068-af18-4915-aded-94a29efac31a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67442025-01-06T20:37:14.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 99ef7068-af18-4915-aded-94a29efac31a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67452025-01-06T20:37:14.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1777 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 99ef7068-af18-4915-aded-94a29efac31a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67462025-01-06T20:37:14.986ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
67472025-01-06T20:37:14.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67482025-01-06T20:37:14.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67492025-01-06T20:37:14.987ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
67502025-01-06T20:37:14.987ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67512025-01-06T20:37:14.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67522025-01-06T20:37:14.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67532025-01-06T20:37:14.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67542025-01-06T20:37:14.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67552025-01-06T20:37:14.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67562025-01-06T20:37:14.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67572025-01-06T20:37:14.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67582025-01-06T20:37:14.991ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.991448ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67592025-01-06T20:37:14.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67602025-01-06T20:37:14.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67612025-01-06T20:37:14.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67622025-01-06T20:37:14.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
67632025-01-06T20:37:14.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67642025-01-06T20:37:14.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67652025-01-06T20:37:15.005ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
67662025-01-06T20:37:15.006ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.44161ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
67672025-01-06T20:37:15.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e9f404ee-29d3-432e-b4c8-8582edad6d48 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67682025-01-06T20:37:15.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e9f404ee-29d3-432e-b4c8-8582edad6d48 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67692025-01-06T20:37:15.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e9f404ee-29d3-432e-b4c8-8582edad6d48 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67702025-01-06T20:37:16.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 86ea0610-9901-4ae3-b55b-9ead1a4625cb roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67712025-01-06T20:37:16.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 86ea0610-9901-4ae3-b55b-9ead1a4625cb resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67722025-01-06T20:37:16.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 86ea0610-9901-4ae3-b55b-9ead1a4625cb response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67732025-01-06T20:37:17.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 798 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 2d56e75b-9176-4450-b820-6956ae6db405 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
67742025-01-06T20:37:17.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 79ed6b64-e539-44ec-b5fe-bc59216a62a0 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67752025-01-06T20:37:17.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 79ed6b64-e539-44ec-b5fe-bc59216a62a0 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67762025-01-06T20:37:17.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 79ed6b64-e539-44ec-b5fe-bc59216a62a0 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67772025-01-06T20:37:18.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 65169ef7-9abc-4c80-a0a9-9dc6978b7589 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67782025-01-06T20:37:18.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 65169ef7-9abc-4c80-a0a9-9dc6978b7589 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67792025-01-06T20:37:18.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 65169ef7-9abc-4c80-a0a9-9dc6978b7589 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67802025-01-06T20:37:19.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 826eb427-3ecf-46a1-b3e3-7418e76fb234 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67812025-01-06T20:37:19.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 826eb427-3ecf-46a1-b3e3-7418e76fb234 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67822025-01-06T20:37:19.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 826eb427-3ecf-46a1-b3e3-7418e76fb234 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67832025-01-06T20:37:20.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 970492f3-9202-4e68-b090-d81367144af6 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67842025-01-06T20:37:20.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 970492f3-9202-4e68-b090-d81367144af6 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67852025-01-06T20:37:20.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2772 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 970492f3-9202-4e68-b090-d81367144af6 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67862025-01-06T20:37:21.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1bb631c5-7398-4682-90ab-165424632706 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67872025-01-06T20:37:21.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1bb631c5-7398-4682-90ab-165424632706 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67882025-01-06T20:37:21.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1bb631c5-7398-4682-90ab-165424632706 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67892025-01-06T20:37:22.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dfd3e429-0999-48bc-ac4c-35fbd284c123 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67902025-01-06T20:37:22.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dfd3e429-0999-48bc-ac4c-35fbd284c123 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67912025-01-06T20:37:22.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dfd3e429-0999-48bc-ac4c-35fbd284c123 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67922025-01-06T20:37:23.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5ec7717d-b251-4fb8-b8ec-3c937b1eeede roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67932025-01-06T20:37:23.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5ec7717d-b251-4fb8-b8ec-3c937b1eeede resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67942025-01-06T20:37:23.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5ec7717d-b251-4fb8-b8ec-3c937b1eeede response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67952025-01-06T20:37:24.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 144e0e4f-54e1-46b4-b48d-e9e632692110 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67962025-01-06T20:37:24.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 144e0e4f-54e1-46b4-b48d-e9e632692110 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67972025-01-06T20:37:24.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 144e0e4f-54e1-46b4-b48d-e9e632692110 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
67982025-01-06T20:37:24.987ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
67992025-01-06T20:37:24.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68002025-01-06T20:37:24.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68012025-01-06T20:37:24.987ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
68022025-01-06T20:37:24.987ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68032025-01-06T20:37:24.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68042025-01-06T20:37:24.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68052025-01-06T20:37:24.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68062025-01-06T20:37:24.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68072025-01-06T20:37:24.990ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.446164ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68082025-01-06T20:37:24.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68092025-01-06T20:37:24.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68102025-01-06T20:37:24.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68112025-01-06T20:37:24.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68122025-01-06T20:37:24.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68132025-01-06T20:37:24.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68142025-01-06T20:37:24.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
68152025-01-06T20:37:24.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68162025-01-06T20:37:24.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68172025-01-06T20:37:25.008ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
68182025-01-06T20:37:25.008ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.621748ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
68192025-01-06T20:37:25.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fd7d9168-aa65-45ce-ba02-63663c7ec546 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68202025-01-06T20:37:25.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fd7d9168-aa65-45ce-ba02-63663c7ec546 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68212025-01-06T20:37:25.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fd7d9168-aa65-45ce-ba02-63663c7ec546 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68222025-01-06T20:37:27.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f9cd1645-37e2-4279-b243-b665763f232f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68232025-01-06T20:37:27.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f9cd1645-37e2-4279-b243-b665763f232f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68242025-01-06T20:37:27.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f9cd1645-37e2-4279-b243-b665763f232f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68252025-01-06T20:37:27.760ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 830 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = e1b4def6-2e09-4f1e-a2ea-d5670ad7e713 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
68262025-01-06T20:37:28.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0e0cd844-fb38-4c3f-a5b3-9a0e9972a826 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68272025-01-06T20:37:28.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0e0cd844-fb38-4c3f-a5b3-9a0e9972a826 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68282025-01-06T20:37:28.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0e0cd844-fb38-4c3f-a5b3-9a0e9972a826 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68292025-01-06T20:37:29.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9d0647b9-6d00-434d-9cf3-700709240a29 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68302025-01-06T20:37:29.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9d0647b9-6d00-434d-9cf3-700709240a29 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68312025-01-06T20:37:29.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9d0647b9-6d00-434d-9cf3-700709240a29 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68322025-01-06T20:37:30.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3b0a9b08-2673-4688-ac8f-02bc2e5c5c71 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68332025-01-06T20:37:30.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3b0a9b08-2673-4688-ac8f-02bc2e5c5c71 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68342025-01-06T20:37:30.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3b0a9b08-2673-4688-ac8f-02bc2e5c5c71 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68352025-01-06T20:37:31.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 39fd022b-0313-476f-8994-a31a9ea3c031 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68362025-01-06T20:37:31.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 39fd022b-0313-476f-8994-a31a9ea3c031 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68372025-01-06T20:37:31.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 39fd022b-0313-476f-8994-a31a9ea3c031 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68382025-01-06T20:37:32.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 55b996dd-4807-437e-a28f-3a7167b39798 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68392025-01-06T20:37:32.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 55b996dd-4807-437e-a28f-3a7167b39798 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68402025-01-06T20:37:32.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 55b996dd-4807-437e-a28f-3a7167b39798 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68412025-01-06T20:37:33.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a1c66fed-55cf-45e9-b28f-e934cce3a2be roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68422025-01-06T20:37:33.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a1c66fed-55cf-45e9-b28f-e934cce3a2be resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68432025-01-06T20:37:33.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a1c66fed-55cf-45e9-b28f-e934cce3a2be response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68442025-01-06T20:37:34.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7340b549-7e00-4ed3-b290-98a3caeb8a72 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68452025-01-06T20:37:34.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7340b549-7e00-4ed3-b290-98a3caeb8a72 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68462025-01-06T20:37:34.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7340b549-7e00-4ed3-b290-98a3caeb8a72 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
68472025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
68482025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
68492025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68502025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
68512025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
68522025-01-06T20:37:34.987ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-06 20:27:34.987169591 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
68532025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
68542025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
68552025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
68562025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68572025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
68582025-01-06T20:37:34.987ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468
68592025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.29\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468"}
68602025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
68612025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
68622025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
68632025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68642025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
68652025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
68662025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68672025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
68682025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68692025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
68702025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
68712025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
68722025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
68732025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
68742025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
68752025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68762025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
68772025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
68782025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
68792025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
68802025-01-06T20:37:34.987ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68812025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
68822025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68832025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
68842025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
68852025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
68862025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68872025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68882025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
68892025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
68902025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68912025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68922025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
68932025-01-06T20:37:34.988ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
68942025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68952025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68962025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
68972025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68982025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
68992025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
69002025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69012025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69022025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
69032025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
69042025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
69052025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69062025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
69072025-01-06T20:37:34.988ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
69082025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
69092025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
69102025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
69112025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
69122025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69132025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69142025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69152025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
69162025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
69172025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69182025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69192025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69202025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69212025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69222025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
69232025-01-06T20:37:34.988ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65bacdd1-9837-48ad-941c-aec5e2d79006.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1297, tv_nsec: 678456212 } })
69242025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69252025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69262025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69272025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69282025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69292025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69302025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69312025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69322025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69332025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69342025-01-06T20:37:34.988ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("88aaaee6-38b4-4a83-9c08-04f0ea18e003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8dd67555-06fb-4cef-b914-9650f0eeb68a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1297, tv_nsec: 678657247 } })
69352025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69362025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
69372025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69382025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69392025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69402025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69412025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
69422025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.541471ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
69432025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69442025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69452025-01-06T20:37:34.988ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
69462025-01-06T20:37:34.989ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.664025ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
69472025-01-06T20:37:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69482025-01-06T20:37:34.989ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69492025-01-06T20:37:34.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69502025-01-06T20:37:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69512025-01-06T20:37:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69522025-01-06T20:37:34.990ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1297, tv_nsec: 680400835 } })
69532025-01-06T20:37:34.990ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
69542025-01-06T20:37:34.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69552025-01-06T20:37:34.991ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69562025-01-06T20:37:34.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69572025-01-06T20:37:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69582025-01-06T20:37:34.992ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-06 20:27:34.987169591 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
69592025-01-06T20:37:34.992ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.925604ms iteration = 10 status = {"expiration":"2025-01-06T20:27:34.987169591Z","pruned":[]}
69602025-01-06T20:37:34.992ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.814751ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
69612025-01-06T20:37:34.992ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.921303ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
69622025-01-06T20:37:34.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
69632025-01-06T20:37:34.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69642025-01-06T20:37:34.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69652025-01-06T20:37:34.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69662025-01-06T20:37:34.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69672025-01-06T20:37:34.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69682025-01-06T20:37:34.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69692025-01-06T20:37:34.996ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.204531ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
69702025-01-06T20:37:34.997ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69712025-01-06T20:37:34.997ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69722025-01-06T20:37:34.997ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69732025-01-06T20:37:34.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69742025-01-06T20:37:34.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
69752025-01-06T20:37:34.999ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69762025-01-06T20:37:34.999ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69772025-01-06T20:37:34.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69782025-01-06T20:37:35.000ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69792025-01-06T20:37:35.001ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
69802025-01-06T20:37:35.001ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69812025-01-06T20:37:35.001ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1297, tv_nsec: 691784295 } })
69822025-01-06T20:37:35.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69832025-01-06T20:37:35.001ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
69842025-01-06T20:37:35.002ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
69852025-01-06T20:37:35.002ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69862025-01-06T20:37:35.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69872025-01-06T20:37:35.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69882025-01-06T20:37:35.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69892025-01-06T20:37:35.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69902025-01-06T20:37:35.008ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
69912025-01-06T20:37:35.008ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
69922025-01-06T20:37:35.008ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.327344ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
69932025-01-06T20:37:35.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
69942025-01-06T20:37:35.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69952025-01-06T20:37:35.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69962025-01-06T20:37:35.014ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69972025-01-06T20:37:35.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
69982025-01-06T20:37:35.017ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69992025-01-06T20:37:35.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70002025-01-06T20:37:35.017ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70012025-01-06T20:37:35.019ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70022025-01-06T20:37:35.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70032025-01-06T20:37:35.019ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70042025-01-06T20:37:35.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70052025-01-06T20:37:35.020ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70062025-01-06T20:37:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70072025-01-06T20:37:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70082025-01-06T20:37:35.023ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70092025-01-06T20:37:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70102025-01-06T20:37:35.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70112025-01-06T20:37:35.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70122025-01-06T20:37:35.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70132025-01-06T20:37:35.031ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1297, tv_nsec: 721750791 } })
70142025-01-06T20:37:35.034ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
70152025-01-06T20:37:35.034ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70162025-01-06T20:37:35.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70172025-01-06T20:37:35.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70182025-01-06T20:37:35.036ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70192025-01-06T20:37:35.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70202025-01-06T20:37:35.037ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
70212025-01-06T20:37:35.037ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 50.247988ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
70222025-01-06T20:37:35.039ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70232025-01-06T20:37:35.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70242025-01-06T20:37:35.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70252025-01-06T20:37:35.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
70262025-01-06T20:37:35.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70272025-01-06T20:37:35.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70282025-01-06T20:37:35.057ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70292025-01-06T20:37:35.058ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70302025-01-06T20:37:35.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70312025-01-06T20:37:35.058ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70322025-01-06T20:37:35.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70332025-01-06T20:37:35.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
70342025-01-06T20:37:35.062ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
70352025-01-06T20:37:35.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
70362025-01-06T20:37:35.063ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 75.989178ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
70372025-01-06T20:37:35.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 77.255703ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70382025-01-06T20:37:35.068ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70392025-01-06T20:37:35.068ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
70402025-01-06T20:37:35.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70412025-01-06T20:37:35.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70422025-01-06T20:37:35.074ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70432025-01-06T20:37:35.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70442025-01-06T20:37:35.077ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70452025-01-06T20:37:35.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70462025-01-06T20:37:35.081ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70472025-01-06T20:37:35.082ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
70482025-01-06T20:37:35.082ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.907283ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
70492025-01-06T20:37:35.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70502025-01-06T20:37:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70512025-01-06T20:37:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 98.763879ms iteration = 5 status = {"nsuccess":5}
70522025-01-06T20:37:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70532025-01-06T20:37:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70542025-01-06T20:37:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70552025-01-06T20:37:35.087ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70562025-01-06T20:37:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70572025-01-06T20:37:35.093ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
70582025-01-06T20:37:35.093ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
70592025-01-06T20:37:35.093ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
70602025-01-06T20:37:35.093ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70612025-01-06T20:37:35.093ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.384249ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70622025-01-06T20:37:35.093ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70632025-01-06T20:37:35.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70642025-01-06T20:37:35.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70652025-01-06T20:37:35.095ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70662025-01-06T20:37:35.096ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70672025-01-06T20:37:35.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70682025-01-06T20:37:35.098ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70692025-01-06T20:37:35.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70702025-01-06T20:37:35.099ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 111.155656ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70712025-01-06T20:37:35.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70722025-01-06T20:37:35.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70732025-01-06T20:37:35.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70742025-01-06T20:37:35.102ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70752025-01-06T20:37:35.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70762025-01-06T20:37:35.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
70772025-01-06T20:37:35.106ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70782025-01-06T20:37:35.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70792025-01-06T20:37:35.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70802025-01-06T20:37:35.108ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70812025-01-06T20:37:35.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70822025-01-06T20:37:35.109ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
70832025-01-06T20:37:35.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
70842025-01-06T20:37:35.130ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70852025-01-06T20:37:35.130ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70862025-01-06T20:37:35.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70872025-01-06T20:37:35.133ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
70882025-01-06T20:37:35.133ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
70892025-01-06T20:37:35.133ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 145.636424ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
70902025-01-06T20:37:35.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
70912025-01-06T20:37:35.133ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70922025-01-06T20:37:35.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70932025-01-06T20:37:35.135ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70942025-01-06T20:37:35.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70952025-01-06T20:37:35.136ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 148.896413ms iteration = 19 status = 0
70962025-01-06T20:37:35.137ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70972025-01-06T20:37:35.137ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70982025-01-06T20:37:35.137ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70992025-01-06T20:37:35.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71002025-01-06T20:37:35.142ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
71012025-01-06T20:37:35.142ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
71022025-01-06T20:37:35.142ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
71032025-01-06T20:37:35.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71042025-01-06T20:37:35.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71052025-01-06T20:37:35.144ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71062025-01-06T20:37:35.147ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71072025-01-06T20:37:35.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71082025-01-06T20:37:35.147ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71092025-01-06T20:37:35.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71102025-01-06T20:37:35.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71112025-01-06T20:37:35.148ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71122025-01-06T20:37:35.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71132025-01-06T20:37:35.148ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71142025-01-06T20:37:35.150ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
71152025-01-06T20:37:35.150ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 0 version = 2
71162025-01-06T20:37:35.150ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71172025-01-06T20:37:35.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71182025-01-06T20:37:35.151ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71192025-01-06T20:37:35.151ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71202025-01-06T20:37:35.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71212025-01-06T20:37:35.160ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
71222025-01-06T20:37:35.160ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
71232025-01-06T20:37:35.160ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71242025-01-06T20:37:35.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71252025-01-06T20:37:35.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 179.961789ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
71262025-01-06T20:37:35.171ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
71272025-01-06T20:37:35.173ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71282025-01-06T20:37:35.173ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71292025-01-06T20:37:35.173ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 185.689725ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71302025-01-06T20:37:35.175ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
71312025-01-06T20:37:35.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 459387d5-6c97-4dba-9a20-48a18d6051e1 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
71322025-01-06T20:37:35.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 459387d5-6c97-4dba-9a20-48a18d6051e1 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
71332025-01-06T20:37:35.191ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
71342025-01-06T20:37:35.191ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 203.553731ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
71352025-01-06T20:37:35.198ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71362025-01-06T20:37:35.198ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71372025-01-06T20:37:35.199ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd3d47e5-3ab4-4967-9c76-8f89684e4404", "content-length": "26", "date": "Mon, 06 Jan 2025 20:37:35 GMT"} })
71382025-01-06T20:37:35.199ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71392025-01-06T20:37:35.201ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71402025-01-06T20:37:35.209ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
71412025-01-06T20:37:35.209ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71422025-01-06T20:37:35.209ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "63665f44-2169-4da1-a8aa-86e22b7a7038", "content-length": "26", "date": "Mon, 06 Jan 2025 20:37:35 GMT"} })
71432025-01-06T20:37:35.209ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71442025-01-06T20:37:35.211ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
71452025-01-06T20:37:35.245ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 257.811849ms iteration = 21 status = {"physical_disks_added":0}
71462025-01-06T20:37:35.311ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
71472025-01-06T20:37:35.311ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71482025-01-06T20:37:35.312ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d9b891f-6bb1-4e81-9f14-0ba205698818", "content-length": "372", "date": "Mon, 06 Jan 2025 20:37:35 GMT"} })
71492025-01-06T20:37:35.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71502025-01-06T20:37:35.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71512025-01-06T20:37:35.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71522025-01-06T20:37:35.314ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71532025-01-06T20:37:35.314ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71542025-01-06T20:37:35.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71552025-01-06T20:37:35.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 459387d5-6c97-4dba-9a20-48a18d6051e1 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
71562025-01-06T20:37:35.316ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71572025-01-06T20:37:35.316ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71582025-01-06T20:37:35.316ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c903990-10f7-4607-be96-15d37fc1bbaf", "content-length": "26", "date": "Mon, 06 Jan 2025 20:37:35 GMT"} })
71592025-01-06T20:37:35.316ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71602025-01-06T20:37:35.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71612025-01-06T20:37:35.317ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71622025-01-06T20:37:35.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71632025-01-06T20:37:35.318ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71642025-01-06T20:37:35.318ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71652025-01-06T20:37:35.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71662025-01-06T20:37:35.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71672025-01-06T20:37:35.318ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71682025-01-06T20:37:35.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71692025-01-06T20:37:35.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71702025-01-06T20:37:35.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71712025-01-06T20:37:35.319ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71722025-01-06T20:37:35.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71732025-01-06T20:37:35.322ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 1 version = 2
71742025-01-06T20:37:35.322ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
71752025-01-06T20:37:35.322ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-06 20:28:37.181288 UTC dns_group = external generation = 2
71762025-01-06T20:37:35.322ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 334.964948ms iteration = 10 status = {"generation":2}
71772025-01-06T20:37:35.323ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
71782025-01-06T20:37:35.323ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
71792025-01-06T20:37:35.323ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-06 20:28:35.848690 UTC dns_group = internal generation = 1
71802025-01-06T20:37:35.323ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 336.227813ms iteration = 10 status = {"generation":1}
71812025-01-06T20:37:35.365ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
71822025-01-06T20:37:35.366ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1a53127-708c-470e-ab0c-2054798ec192", "content-length": "1", "date": "Mon, 06 Jan 2025 20:37:34 GMT"} })
71832025-01-06T20:37:35.368ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71842025-01-06T20:37:35.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71852025-01-06T20:37:35.369ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
71862025-01-06T20:37:35.370ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 383.317104ms iteration = 19 status = null
71872025-01-06T20:37:35.374ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-06T20:28:32.843602Z, time_modified: 2025-01-06T20:28:32.843602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }) }
71882025-01-06T20:37:35.374ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 386.949863ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]}},"default_endpoint":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
71892025-01-06T20:37:35.377ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
71902025-01-06T20:37:35.377ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
71912025-01-06T20:37:35.377ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c9bc0024-47c5-41d2-b389-9f47d397a164", "date": "Mon, 06 Jan 2025 20:37:35 GMT"} })
71922025-01-06T20:37:35.377ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71932025-01-06T20:37:35.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71942025-01-06T20:37:35.379ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71952025-01-06T20:37:35.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71962025-01-06T20:37:35.402ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
71972025-01-06T20:37:35.403ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "528e9231-ab81-4d9b-a12c-2d738813d067", "date": "Mon, 06 Jan 2025 20:37:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71982025-01-06T20:37:35.403ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
71992025-01-06T20:37:35.404ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2341e0ff-b290-4345-a061-41b1a542e5ac", "date": "Mon, 06 Jan 2025 20:37:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72002025-01-06T20:37:35.404ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72012025-01-06T20:37:35.405ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72022025-01-06T20:37:35.405ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 418.600714ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
72032025-01-06T20:37:35.473ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 486.306737ms iteration = 19 status = {}
72042025-01-06T20:37:35.492ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
72052025-01-06T20:37:35.492ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d18f5de4-54fb-462a-ac59-5f42b2bc4834", "date": "Mon, 06 Jan 2025 20:37:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72062025-01-06T20:37:35.492ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72072025-01-06T20:37:35.493ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7e8c3444-2b8f-493f-a3aa-b09f205bf2da", "date": "Mon, 06 Jan 2025 20:37:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72082025-01-06T20:37:35.493ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72092025-01-06T20:37:35.495ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7ae98101-cb8b-431f-b7b3-279b1e64c5e5", "date": "Mon, 06 Jan 2025 20:37:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72102025-01-06T20:37:35.495ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72112025-01-06T20:37:35.496ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
72122025-01-06T20:37:35.496ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 509.456798ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
72132025-01-06T20:37:35.528ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72142025-01-06T20:37:35.529ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f4d0b05-798e-42fd-b009-1eebbb14962e", "content-length": "691", "date": "Mon, 06 Jan 2025 20:37:35 GMT"} })
72152025-01-06T20:37:35.529ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
72162025-01-06T20:37:35.529ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
72172025-01-06T20:37:35.529ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
72182025-01-06T20:37:35.530ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 542.830766ms iteration = 19 status = {}
72192025-01-06T20:37:35.532ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72202025-01-06T20:37:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72212025-01-06T20:37:35.535ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
72222025-01-06T20:37:35.535ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72232025-01-06T20:37:35.535ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e439e936-1a64-4876-9256-e35ae90b89d7", "date": "Mon, 06 Jan 2025 20:37:35 GMT"} })
72242025-01-06T20:37:35.537ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 549.927959ms iteration = 19 status = {}
72252025-01-06T20:37:35.572ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72262025-01-06T20:37:35.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72272025-01-06T20:37:35.575ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
72282025-01-06T20:37:35.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72292025-01-06T20:37:35.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72302025-01-06T20:37:35.584ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72312025-01-06T20:37:35.584ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5082069f-eb1e-4ae8-8267-6a032bfcc9b0", "content-length": "134", "date": "Mon, 06 Jan 2025 20:37:35 GMT"} })
72322025-01-06T20:37:35.584ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
72332025-01-06T20:37:35.585ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
72342025-01-06T20:37:35.585ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72352025-01-06T20:37:35.585ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72362025-01-06T20:37:35.585ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72372025-01-06T20:37:35.585ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72382025-01-06T20:37:35.585ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72392025-01-06T20:37:35.585ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72402025-01-06T20:37:35.585ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72412025-01-06T20:37:35.585ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72422025-01-06T20:37:35.585ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
72432025-01-06T20:37:35.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72442025-01-06T20:37:35.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72452025-01-06T20:37:35.588ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72462025-01-06T20:37:35.588ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "edc57306-d8e6-494b-b58c-c339d1d8dabb", "content-length": "2", "date": "Mon, 06 Jan 2025 20:37:35 GMT"} })
72472025-01-06T20:37:35.588ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72482025-01-06T20:37:35.588ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "61c90be6-daf0-4163-80df-937392c2e714", "content-length": "52", "date": "Mon, 06 Jan 2025 20:37:35 GMT"} })
72492025-01-06T20:37:35.588ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
72502025-01-06T20:37:35.588ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72512025-01-06T20:37:35.776ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "367adba9-9adf-47ee-b29a-69efe4f3997d", "date": "Mon, 06 Jan 2025 20:37:35 GMT"} })
72522025-01-06T20:37:35.776ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
72532025-01-06T20:37:35.776ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72542025-01-06T20:37:35.782ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4122c52-c106-4791-8246-a9bcaa8873a6", "content-length": "682", "date": "Mon, 06 Jan 2025 20:37:35 GMT"} })
72552025-01-06T20:37:35.782ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72562025-01-06T20:37:35.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72572025-01-06T20:37:35.786ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72582025-01-06T20:37:35.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72592025-01-06T20:37:35.789ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72602025-01-06T20:37:35.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72612025-01-06T20:37:35.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72622025-01-06T20:37:35.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72632025-01-06T20:37:35.797ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 810.491843ms iteration = 19 status = {}
72642025-01-06T20:37:36.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8d6828c2-d82b-4207-a888-043b7d6f1a2a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72652025-01-06T20:37:36.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8d6828c2-d82b-4207-a888-043b7d6f1a2a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72662025-01-06T20:37:36.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8d6828c2-d82b-4207-a888-043b7d6f1a2a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72672025-01-06T20:37:37.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c05fcf58-9c08-4ddd-9d37-3400f6fd8339 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72682025-01-06T20:37:37.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c05fcf58-9c08-4ddd-9d37-3400f6fd8339 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72692025-01-06T20:37:37.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c05fcf58-9c08-4ddd-9d37-3400f6fd8339 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72702025-01-06T20:37:37.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 567 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 6d772c8f-5ff8-40e4-b5b9-81bf32ff7540 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
72712025-01-06T20:37:38.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 209565ba-bfab-49ff-9701-d1537e414570 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72722025-01-06T20:37:38.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 209565ba-bfab-49ff-9701-d1537e414570 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72732025-01-06T20:37:38.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 209565ba-bfab-49ff-9701-d1537e414570 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72742025-01-06T20:37:39.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9661872d-dbea-4949-abef-130ab6eebb89 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72752025-01-06T20:37:39.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9661872d-dbea-4949-abef-130ab6eebb89 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72762025-01-06T20:37:39.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9661872d-dbea-4949-abef-130ab6eebb89 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72772025-01-06T20:37:40.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6dedd26e-7d0c-49c2-b757-1477ce11d552 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72782025-01-06T20:37:40.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6dedd26e-7d0c-49c2-b757-1477ce11d552 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72792025-01-06T20:37:40.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6dedd26e-7d0c-49c2-b757-1477ce11d552 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72802025-01-06T20:37:41.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b8bdd9c4-4d2a-41bc-9228-df1a7d2203be roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72812025-01-06T20:37:41.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b8bdd9c4-4d2a-41bc-9228-df1a7d2203be resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72822025-01-06T20:37:41.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b8bdd9c4-4d2a-41bc-9228-df1a7d2203be response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72832025-01-06T20:37:42.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ea0cac91-cf2e-4267-b8c4-9b960e7ce3dc roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72842025-01-06T20:37:42.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ea0cac91-cf2e-4267-b8c4-9b960e7ce3dc resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72852025-01-06T20:37:42.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ea0cac91-cf2e-4267-b8c4-9b960e7ce3dc response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72862025-01-06T20:37:43.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d6384bc0-ed19-4082-903f-3c9093355ccb roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72872025-01-06T20:37:43.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d6384bc0-ed19-4082-903f-3c9093355ccb resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72882025-01-06T20:37:43.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d6384bc0-ed19-4082-903f-3c9093355ccb response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72892025-01-06T20:37:44.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 00ba45da-b551-44d8-b696-96cb2a0a3b55 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72902025-01-06T20:37:44.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 00ba45da-b551-44d8-b696-96cb2a0a3b55 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72912025-01-06T20:37:44.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 00ba45da-b551-44d8-b696-96cb2a0a3b55 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
72922025-01-06T20:37:44.986ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
72932025-01-06T20:37:44.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72942025-01-06T20:37:44.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72952025-01-06T20:37:44.988ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
72962025-01-06T20:37:44.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72972025-01-06T20:37:44.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72982025-01-06T20:37:44.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72992025-01-06T20:37:44.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73002025-01-06T20:37:44.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73012025-01-06T20:37:44.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73022025-01-06T20:37:44.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73032025-01-06T20:37:44.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73042025-01-06T20:37:44.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73052025-01-06T20:37:44.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
73062025-01-06T20:37:44.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73072025-01-06T20:37:44.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73082025-01-06T20:37:45.007ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
73092025-01-06T20:37:45.008ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.741932ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
73102025-01-06T20:37:45.016ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73112025-01-06T20:37:45.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73122025-01-06T20:37:45.018ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.913215ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73132025-01-06T20:37:45.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3228e591-08a4-4864-a07c-aec9b03f4f66 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73142025-01-06T20:37:45.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3228e591-08a4-4864-a07c-aec9b03f4f66 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73152025-01-06T20:37:45.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3228e591-08a4-4864-a07c-aec9b03f4f66 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73162025-01-06T20:37:46.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5535da1a-e552-4bfd-8555-ba91e65c8ccd roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73172025-01-06T20:37:46.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5535da1a-e552-4bfd-8555-ba91e65c8ccd resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73182025-01-06T20:37:46.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5535da1a-e552-4bfd-8555-ba91e65c8ccd response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73192025-01-06T20:37:47.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b7dc1eb0-5775-44b8-acb5-0a0e6b980acf roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73202025-01-06T20:37:47.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b7dc1eb0-5775-44b8-acb5-0a0e6b980acf resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73212025-01-06T20:37:47.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b7dc1eb0-5775-44b8-acb5-0a0e6b980acf response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73222025-01-06T20:37:47.760ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 550 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 58619da9-8744-4002-94b1-14d7527318dd response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
73232025-01-06T20:37:48.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d0c306bc-5db6-404c-a56b-9c90e36b113c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73242025-01-06T20:37:48.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d0c306bc-5db6-404c-a56b-9c90e36b113c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73252025-01-06T20:37:48.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2685 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d0c306bc-5db6-404c-a56b-9c90e36b113c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73262025-01-06T20:37:49.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 82c295b2-6e05-40a3-a8e3-fa37698e1603 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73272025-01-06T20:37:49.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 82c295b2-6e05-40a3-a8e3-fa37698e1603 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73282025-01-06T20:37:49.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 82c295b2-6e05-40a3-a8e3-fa37698e1603 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73292025-01-06T20:37:50.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d82149b2-1661-4291-a5b4-b734e0c72653 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73302025-01-06T20:37:50.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d82149b2-1661-4291-a5b4-b734e0c72653 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73312025-01-06T20:37:50.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d82149b2-1661-4291-a5b4-b734e0c72653 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73322025-01-06T20:37:51.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 205a382f-8ed6-4aa4-9d5a-85b585f13e66 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73332025-01-06T20:37:51.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 205a382f-8ed6-4aa4-9d5a-85b585f13e66 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73342025-01-06T20:37:51.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 205a382f-8ed6-4aa4-9d5a-85b585f13e66 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73352025-01-06T20:37:52.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b5a9660c-7627-48fb-b8fb-15765f486fd9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73362025-01-06T20:37:52.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b5a9660c-7627-48fb-b8fb-15765f486fd9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73372025-01-06T20:37:52.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b5a9660c-7627-48fb-b8fb-15765f486fd9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73382025-01-06T20:37:53.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eb375852-1ed7-48cc-9170-f30e2198136e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73392025-01-06T20:37:53.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eb375852-1ed7-48cc-9170-f30e2198136e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73402025-01-06T20:37:53.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eb375852-1ed7-48cc-9170-f30e2198136e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73412025-01-06T20:37:54.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eed6d078-4365-45bb-ba2f-0616d47f2170 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73422025-01-06T20:37:54.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eed6d078-4365-45bb-ba2f-0616d47f2170 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73432025-01-06T20:37:54.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2809 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eed6d078-4365-45bb-ba2f-0616d47f2170 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73442025-01-06T20:37:54.986ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
73452025-01-06T20:37:54.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73462025-01-06T20:37:54.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73472025-01-06T20:37:54.987ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
73482025-01-06T20:37:54.987ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73492025-01-06T20:37:54.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73502025-01-06T20:37:54.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73512025-01-06T20:37:54.990ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73522025-01-06T20:37:54.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73532025-01-06T20:37:54.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73542025-01-06T20:37:54.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73552025-01-06T20:37:54.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73562025-01-06T20:37:54.992ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.782531ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73572025-01-06T20:37:54.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73582025-01-06T20:37:54.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73592025-01-06T20:37:54.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73602025-01-06T20:37:54.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
73612025-01-06T20:37:54.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73622025-01-06T20:37:54.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73632025-01-06T20:37:55.005ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
73642025-01-06T20:37:55.005ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.585016ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
73652025-01-06T20:37:55.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e90ffb37-50ef-4257-9adc-3bfa7186cd9f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73662025-01-06T20:37:55.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e90ffb37-50ef-4257-9adc-3bfa7186cd9f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73672025-01-06T20:37:55.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e90ffb37-50ef-4257-9adc-3bfa7186cd9f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73682025-01-06T20:37:56.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a85aa993-f358-440b-9b98-dea401fa02e7 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73692025-01-06T20:37:56.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a85aa993-f358-440b-9b98-dea401fa02e7 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73702025-01-06T20:37:56.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a85aa993-f358-440b-9b98-dea401fa02e7 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73712025-01-06T20:37:57.760ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 870 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 3b9ca639-d3d8-48cc-b070-00576297b67b response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
73722025-01-06T20:37:57.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 224a40ef-5476-4b80-90e6-3f9e6c1ae3ad roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73732025-01-06T20:37:57.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 224a40ef-5476-4b80-90e6-3f9e6c1ae3ad resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73742025-01-06T20:37:57.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 224a40ef-5476-4b80-90e6-3f9e6c1ae3ad response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73752025-01-06T20:37:58.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 576a505a-2e2d-4e4a-8d3f-c200d04c2d5e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73762025-01-06T20:37:58.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 576a505a-2e2d-4e4a-8d3f-c200d04c2d5e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73772025-01-06T20:37:58.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 576a505a-2e2d-4e4a-8d3f-c200d04c2d5e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73782025-01-06T20:37:59.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7a48c9b0-3d0f-4098-96d8-ca61d3e975d8 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73792025-01-06T20:37:59.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7a48c9b0-3d0f-4098-96d8-ca61d3e975d8 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73802025-01-06T20:37:59.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1839 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7a48c9b0-3d0f-4098-96d8-ca61d3e975d8 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73812025-01-06T20:38:00.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5d287007-d38f-4211-9a4c-8b432f5db372 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73822025-01-06T20:38:00.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5d287007-d38f-4211-9a4c-8b432f5db372 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73832025-01-06T20:38:00.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5d287007-d38f-4211-9a4c-8b432f5db372 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73842025-01-06T20:38:01.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a152b678-94c5-4da4-90f1-d314d86db148 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73852025-01-06T20:38:01.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a152b678-94c5-4da4-90f1-d314d86db148 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73862025-01-06T20:38:01.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a152b678-94c5-4da4-90f1-d314d86db148 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73872025-01-06T20:38:02.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5e253703-b5ca-440e-978e-fd28b2e5f096 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73882025-01-06T20:38:02.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5e253703-b5ca-440e-978e-fd28b2e5f096 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73892025-01-06T20:38:02.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5e253703-b5ca-440e-978e-fd28b2e5f096 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73902025-01-06T20:38:03.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 42ceefb4-c5ac-4695-8ad8-931bfcee7026 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73912025-01-06T20:38:03.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 42ceefb4-c5ac-4695-8ad8-931bfcee7026 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73922025-01-06T20:38:03.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 42ceefb4-c5ac-4695-8ad8-931bfcee7026 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73932025-01-06T20:38:04.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4657008f-cf36-4c1f-9202-2f16319bf95e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73942025-01-06T20:38:04.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4657008f-cf36-4c1f-9202-2f16319bf95e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73952025-01-06T20:38:04.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4657008f-cf36-4c1f-9202-2f16319bf95e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
73962025-01-06T20:38:04.986ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
73972025-01-06T20:38:04.986ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
73982025-01-06T20:38:04.986ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
73992025-01-06T20:38:04.986ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
74002025-01-06T20:38:04.986ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74012025-01-06T20:38:04.986ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
74022025-01-06T20:38:04.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74032025-01-06T20:38:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
74042025-01-06T20:38:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74052025-01-06T20:38:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74062025-01-06T20:38:04.987ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
74072025-01-06T20:38:04.987ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
74082025-01-06T20:38:04.987ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74092025-01-06T20:38:04.987ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74102025-01-06T20:38:04.987ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
74112025-01-06T20:38:04.987ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74122025-01-06T20:38:04.987ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
74132025-01-06T20:38:04.987ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
74142025-01-06T20:38:04.987ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74152025-01-06T20:38:04.987ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
74162025-01-06T20:38:04.987ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74172025-01-06T20:38:04.987ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
74182025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74192025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
74202025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
74212025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74222025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
74232025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
74242025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
74252025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74262025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
74272025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74282025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
74292025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74302025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
74312025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
74322025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
74332025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74342025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74352025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74362025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74372025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74382025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74392025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74402025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74412025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74422025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74432025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
74442025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74452025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
74462025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74472025-01-06T20:38:04.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74482025-01-06T20:38:04.989ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1327, tv_nsec: 680402755 } })
74492025-01-06T20:38:04.990ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1327, tv_nsec: 680670742 } })
74502025-01-06T20:38:04.990ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
74512025-01-06T20:38:04.990ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
74522025-01-06T20:38:04.990ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.006239ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
74532025-01-06T20:38:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74542025-01-06T20:38:04.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74552025-01-06T20:38:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74562025-01-06T20:38:04.992ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74572025-01-06T20:38:04.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74582025-01-06T20:38:04.993ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74592025-01-06T20:38:04.994ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74602025-01-06T20:38:04.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74612025-01-06T20:38:04.994ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74622025-01-06T20:38:04.994ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74632025-01-06T20:38:04.994ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74642025-01-06T20:38:04.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74652025-01-06T20:38:04.995ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74662025-01-06T20:38:04.995ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
74672025-01-06T20:38:04.995ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74682025-01-06T20:38:04.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74692025-01-06T20:38:04.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
74702025-01-06T20:38:04.996ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74712025-01-06T20:38:04.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74722025-01-06T20:38:04.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
74732025-01-06T20:38:04.996ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74742025-01-06T20:38:04.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74752025-01-06T20:38:04.997ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74762025-01-06T20:38:04.998ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.177517ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
74772025-01-06T20:38:04.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
74782025-01-06T20:38:04.999ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74792025-01-06T20:38:04.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74802025-01-06T20:38:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74812025-01-06T20:38:05.000ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74822025-01-06T20:38:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74832025-01-06T20:38:05.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74842025-01-06T20:38:05.002ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 14.492115ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
74852025-01-06T20:38:05.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74862025-01-06T20:38:05.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74872025-01-06T20:38:05.003ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74882025-01-06T20:38:05.003ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
74892025-01-06T20:38:05.003ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74902025-01-06T20:38:05.003ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74912025-01-06T20:38:05.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74922025-01-06T20:38:05.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74932025-01-06T20:38:05.004ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74942025-01-06T20:38:05.004ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74952025-01-06T20:38:05.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74962025-01-06T20:38:05.005ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1327, tv_nsec: 695438224 } })
74972025-01-06T20:38:05.005ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
74982025-01-06T20:38:05.006ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74992025-01-06T20:38:05.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75002025-01-06T20:38:05.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75012025-01-06T20:38:05.008ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75022025-01-06T20:38:05.008ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75032025-01-06T20:38:05.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75042025-01-06T20:38:05.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
75052025-01-06T20:38:05.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75062025-01-06T20:38:05.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75072025-01-06T20:38:05.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75082025-01-06T20:38:05.010ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75092025-01-06T20:38:05.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75102025-01-06T20:38:05.018ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
75112025-01-06T20:38:05.018ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 30.278115ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
75122025-01-06T20:38:05.028ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75132025-01-06T20:38:05.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75142025-01-06T20:38:05.031ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.244497ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75152025-01-06T20:38:05.038ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75162025-01-06T20:38:05.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75172025-01-06T20:38:05.040ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75182025-01-06T20:38:05.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75192025-01-06T20:38:05.041ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
75202025-01-06T20:38:05.041ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.691239ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
75212025-01-06T20:38:05.044ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.062646ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
75222025-01-06T20:38:05.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75232025-01-06T20:38:05.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75242025-01-06T20:38:05.046ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
75252025-01-06T20:38:05.046ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75262025-01-06T20:38:05.046ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
75272025-01-06T20:38:05.046ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75282025-01-06T20:38:05.047ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d782108-3d2d-45fd-bb46-af6aae0a6c24", "content-length": "26", "date": "Mon, 06 Jan 2025 20:38:05 GMT"} })
75292025-01-06T20:38:05.047ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75302025-01-06T20:38:05.047ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3bfc98e-60c2-4ca5-ac79-d4ac4c52f12e", "content-length": "26", "date": "Mon, 06 Jan 2025 20:38:05 GMT"} })
75312025-01-06T20:38:05.047ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75322025-01-06T20:38:05.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75332025-01-06T20:38:05.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75342025-01-06T20:38:05.048ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75352025-01-06T20:38:05.049ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75362025-01-06T20:38:05.050ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75372025-01-06T20:38:05.051ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75382025-01-06T20:38:05.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75392025-01-06T20:38:05.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
75402025-01-06T20:38:05.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75412025-01-06T20:38:05.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75422025-01-06T20:38:05.057ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75432025-01-06T20:38:05.057ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
75442025-01-06T20:38:05.058ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 70.005656ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
75452025-01-06T20:38:05.058ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 70.155309ms iteration = 20 status = 0
75462025-01-06T20:38:05.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 85.117727ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
75472025-01-06T20:38:05.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 100.695121ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
75482025-01-06T20:38:05.109ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
75492025-01-06T20:38:05.109ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75502025-01-06T20:38:05.109ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e22174d-4388-4717-84e5-e438ec8a7670", "content-length": "26", "date": "Mon, 06 Jan 2025 20:38:05 GMT"} })
75512025-01-06T20:38:05.109ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75522025-01-06T20:38:05.111ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
75532025-01-06T20:38:05.124ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 136.119215ms iteration = 22 status = {"physical_disks_added":0}
75542025-01-06T20:38:05.129ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75552025-01-06T20:38:05.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75562025-01-06T20:38:05.131ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75572025-01-06T20:38:05.133ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75582025-01-06T20:38:05.133ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75592025-01-06T20:38:05.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75602025-01-06T20:38:05.134ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75612025-01-06T20:38:05.136ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75622025-01-06T20:38:05.136ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75632025-01-06T20:38:05.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75642025-01-06T20:38:05.201ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 214.54162ms iteration = 20 status = {}
75652025-01-06T20:38:05.201ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
75662025-01-06T20:38:05.202ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4941f2f8-1f00-42c8-a53c-1602516a3f52", "content-length": "1", "date": "Mon, 06 Jan 2025 20:38:04 GMT"} })
75672025-01-06T20:38:05.204ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75682025-01-06T20:38:05.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75692025-01-06T20:38:05.207ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 220.501462ms iteration = 20 status = null
75702025-01-06T20:38:05.210ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
75712025-01-06T20:38:05.210ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75722025-01-06T20:38:05.210ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5418c105-fa59-40b5-94b4-e232211a9e40", "content-length": "372", "date": "Mon, 06 Jan 2025 20:38:05 GMT"} })
75732025-01-06T20:38:05.210ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75742025-01-06T20:38:05.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75752025-01-06T20:38:05.232ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
75762025-01-06T20:38:05.232ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
75772025-01-06T20:38:05.232ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0d5e0e4c-9e46-42ba-b72e-5660338e673a", "date": "Mon, 06 Jan 2025 20:38:05 GMT"} })
75782025-01-06T20:38:05.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75792025-01-06T20:38:05.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75802025-01-06T20:38:05.271ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
75812025-01-06T20:38:05.271ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ad36597-8cc5-4df1-a590-32f0597ccb2f", "content-length": "691", "date": "Mon, 06 Jan 2025 20:38:05 GMT"} })
75822025-01-06T20:38:05.271ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
75832025-01-06T20:38:05.271ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
75842025-01-06T20:38:05.271ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
75852025-01-06T20:38:05.273ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 285.191593ms iteration = 20 status = {}
75862025-01-06T20:38:05.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75872025-01-06T20:38:05.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75882025-01-06T20:38:05.278ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75892025-01-06T20:38:05.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75902025-01-06T20:38:05.282ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
75912025-01-06T20:38:05.282ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75922025-01-06T20:38:05.282ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "79e244d5-d349-40f5-bc7b-1482bc4a1cc6", "date": "Mon, 06 Jan 2025 20:38:05 GMT"} })
75932025-01-06T20:38:05.284ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 296.498261ms iteration = 20 status = {}
75942025-01-06T20:38:05.332ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75952025-01-06T20:38:05.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75962025-01-06T20:38:05.334ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
75972025-01-06T20:38:05.334ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75982025-01-06T20:38:05.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75992025-01-06T20:38:05.348ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
76002025-01-06T20:38:05.348ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "91cb721f-9865-4d48-898f-95b6e44b202a", "content-length": "134", "date": "Mon, 06 Jan 2025 20:38:04 GMT"} })
76012025-01-06T20:38:05.348ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
76022025-01-06T20:38:05.348ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
76032025-01-06T20:38:05.348ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
76042025-01-06T20:38:05.348ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
76052025-01-06T20:38:05.348ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76062025-01-06T20:38:05.348ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76072025-01-06T20:38:05.348ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76082025-01-06T20:38:05.348ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76092025-01-06T20:38:05.348ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76102025-01-06T20:38:05.348ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76112025-01-06T20:38:05.349ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
76122025-01-06T20:38:05.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76132025-01-06T20:38:05.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76142025-01-06T20:38:05.351ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
76152025-01-06T20:38:05.351ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f28aece-5243-4cb2-a76a-7391ae8f2a50", "content-length": "2", "date": "Mon, 06 Jan 2025 20:38:04 GMT"} })
76162025-01-06T20:38:05.351ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
76172025-01-06T20:38:05.352ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "607faec2-7740-4ed1-badf-7c5d8354d2e5", "content-length": "52", "date": "Mon, 06 Jan 2025 20:38:04 GMT"} })
76182025-01-06T20:38:05.352ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
76192025-01-06T20:38:05.352ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
76202025-01-06T20:38:05.463ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bf29391c-a11d-4628-976a-6c3fb6bd7ee0", "date": "Mon, 06 Jan 2025 20:38:05 GMT"} })
76212025-01-06T20:38:05.463ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
76222025-01-06T20:38:05.463ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
76232025-01-06T20:38:05.464ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff62d655-d2c8-4350-9b85-b9054f9c4814", "content-length": "682", "date": "Mon, 06 Jan 2025 20:38:05 GMT"} })
76242025-01-06T20:38:05.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76252025-01-06T20:38:05.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76262025-01-06T20:38:05.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76272025-01-06T20:38:05.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76282025-01-06T20:38:05.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76292025-01-06T20:38:05.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76302025-01-06T20:38:05.473ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76312025-01-06T20:38:05.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76322025-01-06T20:38:05.481ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 493.837942ms iteration = 20 status = {}
76332025-01-06T20:38:05.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8022f86d-26ca-4828-88ca-7349da1baf84 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76342025-01-06T20:38:05.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8022f86d-26ca-4828-88ca-7349da1baf84 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76352025-01-06T20:38:05.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8022f86d-26ca-4828-88ca-7349da1baf84 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76362025-01-06T20:38:06.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = db007d1b-3f5f-4942-838b-1792448d4348 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76372025-01-06T20:38:06.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = db007d1b-3f5f-4942-838b-1792448d4348 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76382025-01-06T20:38:06.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2933 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = db007d1b-3f5f-4942-838b-1792448d4348 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76392025-01-06T20:38:07.760ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 586 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = b8cdbb29-eb39-4a41-9c91-e1cc9e571321 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
76402025-01-06T20:38:08.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2991d081-d47d-4010-b164-3c8509018298 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76412025-01-06T20:38:08.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2991d081-d47d-4010-b164-3c8509018298 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76422025-01-06T20:38:08.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2991d081-d47d-4010-b164-3c8509018298 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76432025-01-06T20:38:09.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b22a5594-4cd0-41c8-abf4-68bb16a8ccc1 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76442025-01-06T20:38:09.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b22a5594-4cd0-41c8-abf4-68bb16a8ccc1 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76452025-01-06T20:38:09.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b22a5594-4cd0-41c8-abf4-68bb16a8ccc1 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76462025-01-06T20:38:10.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3ebe37be-b523-4f5b-9c48-1442ea809247 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76472025-01-06T20:38:10.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3ebe37be-b523-4f5b-9c48-1442ea809247 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76482025-01-06T20:38:10.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3ebe37be-b523-4f5b-9c48-1442ea809247 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76492025-01-06T20:38:11.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 160fe16e-ef31-4507-8624-26c912d3bcb8 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76502025-01-06T20:38:11.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 160fe16e-ef31-4507-8624-26c912d3bcb8 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76512025-01-06T20:38:11.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 160fe16e-ef31-4507-8624-26c912d3bcb8 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76522025-01-06T20:38:12.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 24b08d3d-6a50-4ca4-9d69-841d0e4c7b85 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76532025-01-06T20:38:12.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 24b08d3d-6a50-4ca4-9d69-841d0e4c7b85 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76542025-01-06T20:38:12.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 24b08d3d-6a50-4ca4-9d69-841d0e4c7b85 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76552025-01-06T20:38:13.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d15d0e4c-aa8f-4219-b75a-28490f44c240 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76562025-01-06T20:38:13.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d15d0e4c-aa8f-4219-b75a-28490f44c240 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76572025-01-06T20:38:13.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d15d0e4c-aa8f-4219-b75a-28490f44c240 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76582025-01-06T20:38:14.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9fe2dcae-c7f9-4aa5-9887-ba7ddfd12e50 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76592025-01-06T20:38:14.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9fe2dcae-c7f9-4aa5-9887-ba7ddfd12e50 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76602025-01-06T20:38:14.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9fe2dcae-c7f9-4aa5-9887-ba7ddfd12e50 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76612025-01-06T20:38:14.986ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
76622025-01-06T20:38:14.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76632025-01-06T20:38:14.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76642025-01-06T20:38:14.987ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
76652025-01-06T20:38:14.987ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76662025-01-06T20:38:14.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76672025-01-06T20:38:14.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76682025-01-06T20:38:14.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76692025-01-06T20:38:14.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76702025-01-06T20:38:14.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76712025-01-06T20:38:14.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76722025-01-06T20:38:14.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76732025-01-06T20:38:14.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76742025-01-06T20:38:14.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
76752025-01-06T20:38:14.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76762025-01-06T20:38:14.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76772025-01-06T20:38:15.008ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
76782025-01-06T20:38:15.008ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.463182ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
76792025-01-06T20:38:15.016ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76802025-01-06T20:38:15.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76812025-01-06T20:38:15.048ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.874824ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76822025-01-06T20:38:15.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 214fa4e7-dbbb-4fb4-b4a0-b8a8f7eddfc6 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76832025-01-06T20:38:15.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 214fa4e7-dbbb-4fb4-b4a0-b8a8f7eddfc6 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76842025-01-06T20:38:15.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1541 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 214fa4e7-dbbb-4fb4-b4a0-b8a8f7eddfc6 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76852025-01-06T20:38:16.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 285af1aa-c17c-450b-a3c8-0f356ec3c341 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76862025-01-06T20:38:16.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 285af1aa-c17c-450b-a3c8-0f356ec3c341 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76872025-01-06T20:38:16.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 285af1aa-c17c-450b-a3c8-0f356ec3c341 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76882025-01-06T20:38:17.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 828582db-d76f-45f1-be97-af5a95c4351a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76892025-01-06T20:38:17.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 828582db-d76f-45f1-be97-af5a95c4351a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76902025-01-06T20:38:17.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 828582db-d76f-45f1-be97-af5a95c4351a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76912025-01-06T20:38:17.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 872 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = a173885c-f323-4e7b-8358-e5a1a68315ea response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
76922025-01-06T20:38:18.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e1a536a2-f8f9-4d27-b24d-897b08183959 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76932025-01-06T20:38:18.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e1a536a2-f8f9-4d27-b24d-897b08183959 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76942025-01-06T20:38:18.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e1a536a2-f8f9-4d27-b24d-897b08183959 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76952025-01-06T20:38:19.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 36bf14be-9db1-474c-8568-711274372c54 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76962025-01-06T20:38:19.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 36bf14be-9db1-474c-8568-711274372c54 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76972025-01-06T20:38:19.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 36bf14be-9db1-474c-8568-711274372c54 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76982025-01-06T20:38:20.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e25bdc7a-10c1-4170-99bf-601ee7271001 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
76992025-01-06T20:38:20.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e25bdc7a-10c1-4170-99bf-601ee7271001 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77002025-01-06T20:38:20.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1800 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e25bdc7a-10c1-4170-99bf-601ee7271001 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77012025-01-06T20:38:21.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bbc019eb-a126-41b7-8a6c-5820bfaa8d0e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77022025-01-06T20:38:21.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bbc019eb-a126-41b7-8a6c-5820bfaa8d0e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77032025-01-06T20:38:21.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bbc019eb-a126-41b7-8a6c-5820bfaa8d0e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77042025-01-06T20:38:22.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ed79e3c1-86cf-4fca-9176-fc0e723d47f2 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77052025-01-06T20:38:22.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ed79e3c1-86cf-4fca-9176-fc0e723d47f2 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77062025-01-06T20:38:22.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ed79e3c1-86cf-4fca-9176-fc0e723d47f2 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77072025-01-06T20:38:23.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a53d8d82-9b66-459f-b0c1-4a9e18848830 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77082025-01-06T20:38:23.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a53d8d82-9b66-459f-b0c1-4a9e18848830 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77092025-01-06T20:38:23.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a53d8d82-9b66-459f-b0c1-4a9e18848830 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77102025-01-06T20:38:24.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1a41d4f0-a4cf-4504-9f90-a61bee372969 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77112025-01-06T20:38:24.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1a41d4f0-a4cf-4504-9f90-a61bee372969 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77122025-01-06T20:38:24.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1a41d4f0-a4cf-4504-9f90-a61bee372969 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77132025-01-06T20:38:24.986ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
77142025-01-06T20:38:24.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77152025-01-06T20:38:24.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77162025-01-06T20:38:24.987ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
77172025-01-06T20:38:24.987ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77182025-01-06T20:38:24.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77192025-01-06T20:38:24.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77202025-01-06T20:38:24.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77212025-01-06T20:38:24.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77222025-01-06T20:38:24.990ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.751363ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77232025-01-06T20:38:24.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77242025-01-06T20:38:24.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77252025-01-06T20:38:24.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77262025-01-06T20:38:24.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77272025-01-06T20:38:24.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77282025-01-06T20:38:24.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77292025-01-06T20:38:24.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
77302025-01-06T20:38:24.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77312025-01-06T20:38:24.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77322025-01-06T20:38:25.008ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
77332025-01-06T20:38:25.008ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.620818ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
77342025-01-06T20:38:25.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 52de827f-ec51-4f91-975f-699ab79c9616 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77352025-01-06T20:38:25.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 52de827f-ec51-4f91-975f-699ab79c9616 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77362025-01-06T20:38:25.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 52de827f-ec51-4f91-975f-699ab79c9616 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77372025-01-06T20:38:26.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 237c2237-2995-479f-b7cd-d16b1604b302 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77382025-01-06T20:38:26.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 237c2237-2995-479f-b7cd-d16b1604b302 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77392025-01-06T20:38:26.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 237c2237-2995-479f-b7cd-d16b1604b302 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77402025-01-06T20:38:27.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bdac12f0-de5b-49a2-9f5f-46e78dd6c367 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77412025-01-06T20:38:27.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bdac12f0-de5b-49a2-9f5f-46e78dd6c367 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77422025-01-06T20:38:27.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bdac12f0-de5b-49a2-9f5f-46e78dd6c367 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77432025-01-06T20:38:27.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 838 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = eec5e75b-a8f4-4491-8959-2830a60e8ed1 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
77442025-01-06T20:38:28.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1a7986f8-a14d-48dc-b4a1-8d2a38721a2f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77452025-01-06T20:38:28.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1a7986f8-a14d-48dc-b4a1-8d2a38721a2f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77462025-01-06T20:38:28.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1a7986f8-a14d-48dc-b4a1-8d2a38721a2f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77472025-01-06T20:38:29.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 46f1633b-d19a-4b45-97d1-b1b6679b1bd8 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77482025-01-06T20:38:29.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 46f1633b-d19a-4b45-97d1-b1b6679b1bd8 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77492025-01-06T20:38:29.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1927 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 46f1633b-d19a-4b45-97d1-b1b6679b1bd8 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77502025-01-06T20:38:30.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e15ee384-983e-4900-94a8-5bc87604e598 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77512025-01-06T20:38:30.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e15ee384-983e-4900-94a8-5bc87604e598 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77522025-01-06T20:38:30.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2609 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e15ee384-983e-4900-94a8-5bc87604e598 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77532025-01-06T20:38:31.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9fde19a6-0462-4803-9edd-f1876e48fbbe roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77542025-01-06T20:38:31.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9fde19a6-0462-4803-9edd-f1876e48fbbe resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77552025-01-06T20:38:31.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9fde19a6-0462-4803-9edd-f1876e48fbbe response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77562025-01-06T20:38:32.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 36e4b92b-59b0-4416-b9b4-76c334722a29 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77572025-01-06T20:38:32.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 36e4b92b-59b0-4416-b9b4-76c334722a29 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77582025-01-06T20:38:32.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 36e4b92b-59b0-4416-b9b4-76c334722a29 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77592025-01-06T20:38:32.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 58e0f05b-029a-4967-ba60-a4a5e20fbf32 roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
77602025-01-06T20:38:32.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 58e0f05b-029a-4967-ba60-a4a5e20fbf32 resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
77612025-01-06T20:38:32.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 58e0f05b-029a-4967-ba60-a4a5e20fbf32 response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
77622025-01-06T20:38:32.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 5c73ab52-05ea-4adb-b71f-6e76226bf4ba roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
77632025-01-06T20:38:32.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 5c73ab52-05ea-4adb-b71f-6e76226bf4ba resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
77642025-01-06T20:38:32.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 5c73ab52-05ea-4adb-b71f-6e76226bf4ba response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
77652025-01-06T20:38:33.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 373c10f2-1e1c-4908-82fa-57066bdc2a06 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77662025-01-06T20:38:33.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 373c10f2-1e1c-4908-82fa-57066bdc2a06 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77672025-01-06T20:38:33.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 373c10f2-1e1c-4908-82fa-57066bdc2a06 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77682025-01-06T20:38:34.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eefc5bed-a33a-443b-be05-119f6627da75 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77692025-01-06T20:38:34.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eefc5bed-a33a-443b-be05-119f6627da75 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77702025-01-06T20:38:34.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eefc5bed-a33a-443b-be05-119f6627da75 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
77712025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
77722025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77732025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
77742025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
77752025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
77762025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
77772025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77782025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
77792025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
77802025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
77812025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77822025-01-06T20:38:34.986ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468
77832025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
77842025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.261\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468"}
77852025-01-06T20:38:34.986ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-06 20:28:34.986745793 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
77862025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
77872025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
77882025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
77892025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
77902025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
77912025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77922025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
77932025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
77942025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77952025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
77962025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
77972025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
77982025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
77992025-01-06T20:38:34.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78002025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
78012025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
78022025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
78032025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78042025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
78052025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
78062025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78072025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
78082025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78092025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
78102025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
78112025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78122025-01-06T20:38:34.987ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
78132025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78142025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
78152025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78162025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
78172025-01-06T20:38:34.987ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
78182025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
78192025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
78202025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78212025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
78222025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
78232025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
78242025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78252025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
78262025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
78272025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78282025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
78292025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
78302025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
78312025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
78322025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78332025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78342025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
78352025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78362025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
78372025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
78382025-01-06T20:38:34.987ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
78392025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78402025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78412025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
78422025-01-06T20:38:34.987ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
78432025-01-06T20:38:34.987ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
78442025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78452025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
78462025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78472025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
78482025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
78492025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78502025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78512025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78522025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78532025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78542025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78552025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78562025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
78572025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
78582025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
78592025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78602025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78612025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78622025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78632025-01-06T20:38:34.987ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65bacdd1-9837-48ad-941c-aec5e2d79006.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1357, tv_nsec: 678497913 } })
78642025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
78652025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
78662025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78672025-01-06T20:38:34.987ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
78682025-01-06T20:38:34.987ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("88aaaee6-38b4-4a83-9c08-04f0ea18e003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8dd67555-06fb-4cef-b914-9650f0eeb68a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1357, tv_nsec: 678589745 } })
78692025-01-06T20:38:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
78702025-01-06T20:38:34.988ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
78712025-01-06T20:38:34.988ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.428098ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
78722025-01-06T20:38:34.988ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
78732025-01-06T20:38:34.988ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.635555ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
78742025-01-06T20:38:34.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78752025-01-06T20:38:34.989ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1357, tv_nsec: 680471367 } })
78762025-01-06T20:38:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78772025-01-06T20:38:34.990ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
78782025-01-06T20:38:34.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78792025-01-06T20:38:34.990ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78802025-01-06T20:38:34.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78812025-01-06T20:38:34.991ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.304707ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
78822025-01-06T20:38:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78832025-01-06T20:38:34.992ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-06 20:28:34.986745793 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
78842025-01-06T20:38:34.992ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.490339ms iteration = 11 status = {"expiration":"2025-01-06T20:28:34.986745793Z","pruned":[]}
78852025-01-06T20:38:34.992ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78862025-01-06T20:38:34.992ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78872025-01-06T20:38:34.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78882025-01-06T20:38:34.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78892025-01-06T20:38:34.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78902025-01-06T20:38:34.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78912025-01-06T20:38:34.995ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78922025-01-06T20:38:34.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78932025-01-06T20:38:34.996ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1357, tv_nsec: 687163569 } })
78942025-01-06T20:38:34.996ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
78952025-01-06T20:38:34.997ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
78962025-01-06T20:38:34.997ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
78972025-01-06T20:38:34.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
78982025-01-06T20:38:34.998ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78992025-01-06T20:38:34.998ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79002025-01-06T20:38:34.998ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79012025-01-06T20:38:34.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79022025-01-06T20:38:34.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79032025-01-06T20:38:34.999ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79042025-01-06T20:38:34.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79052025-01-06T20:38:35.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79062025-01-06T20:38:35.001ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79072025-01-06T20:38:35.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79082025-01-06T20:38:35.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79092025-01-06T20:38:35.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79102025-01-06T20:38:35.003ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
79112025-01-06T20:38:35.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79122025-01-06T20:38:35.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79132025-01-06T20:38:35.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
79142025-01-06T20:38:35.005ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
79152025-01-06T20:38:35.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
79162025-01-06T20:38:35.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
79172025-01-06T20:38:35.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79182025-01-06T20:38:35.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79192025-01-06T20:38:35.008ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79202025-01-06T20:38:35.009ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79212025-01-06T20:38:35.009ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.40004ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
79222025-01-06T20:38:35.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79232025-01-06T20:38:35.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79242025-01-06T20:38:35.010ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79252025-01-06T20:38:35.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79262025-01-06T20:38:35.011ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
79272025-01-06T20:38:35.011ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
79282025-01-06T20:38:35.011ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 23.87901ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
79292025-01-06T20:38:35.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79302025-01-06T20:38:35.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79312025-01-06T20:38:35.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79322025-01-06T20:38:35.015ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79332025-01-06T20:38:35.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79342025-01-06T20:38:35.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79352025-01-06T20:38:35.020ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
79362025-01-06T20:38:35.020ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
79372025-01-06T20:38:35.020ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
79382025-01-06T20:38:35.020ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79392025-01-06T20:38:35.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79402025-01-06T20:38:35.020ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1357, tv_nsec: 711618525 } })
79412025-01-06T20:38:35.021ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
79422025-01-06T20:38:35.021ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79432025-01-06T20:38:35.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79442025-01-06T20:38:35.022ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(ab59754a-77d3-4112-9295-21cb506c63bb, 0), (7e8be350-5ca2-4536-bcca-fd8de98fc2d3, 0), (ffa138a1-a8e0-4499-a6c2-c943056e232d, 0), (f9d7eca9-cac7-4f29-aba6-001a637b69ad, 0)] collection_id = ab59754a-77d3-4112-9295-21cb506c63bb
79452025-01-06T20:38:35.022ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
79462025-01-06T20:38:35.022ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79472025-01-06T20:38:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79482025-01-06T20:38:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
79492025-01-06T20:38:35.023ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79502025-01-06T20:38:35.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79512025-01-06T20:38:35.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79522025-01-06T20:38:35.025ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79532025-01-06T20:38:35.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
79542025-01-06T20:38:35.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79552025-01-06T20:38:35.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79562025-01-06T20:38:35.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
79572025-01-06T20:38:35.030ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79582025-01-06T20:38:35.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79592025-01-06T20:38:35.037ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79602025-01-06T20:38:35.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79612025-01-06T20:38:35.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79622025-01-06T20:38:35.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
79632025-01-06T20:38:35.065ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79642025-01-06T20:38:35.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79652025-01-06T20:38:35.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79662025-01-06T20:38:35.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79672025-01-06T20:38:35.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79682025-01-06T20:38:35.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79692025-01-06T20:38:35.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 84.85936ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79702025-01-06T20:38:35.071ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79712025-01-06T20:38:35.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79722025-01-06T20:38:35.074ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 87.244005ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
79732025-01-06T20:38:35.074ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 87.552944ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
79742025-01-06T20:38:35.075ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79752025-01-06T20:38:35.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79762025-01-06T20:38:35.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.802958ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79772025-01-06T20:38:35.076ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79782025-01-06T20:38:35.076ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
79792025-01-06T20:38:35.076ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79802025-01-06T20:38:35.076ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
79812025-01-06T20:38:35.076ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 89.037114ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
79822025-01-06T20:38:35.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79832025-01-06T20:38:35.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79842025-01-06T20:38:35.077ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
79852025-01-06T20:38:35.077ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
79862025-01-06T20:38:35.077ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 90.412851ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
79872025-01-06T20:38:35.077ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79882025-01-06T20:38:35.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79892025-01-06T20:38:35.078ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79902025-01-06T20:38:35.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79912025-01-06T20:38:35.079ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79922025-01-06T20:38:35.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79932025-01-06T20:38:35.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79942025-01-06T20:38:35.081ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 94.885553ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79952025-01-06T20:38:35.082ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79962025-01-06T20:38:35.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79972025-01-06T20:38:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79982025-01-06T20:38:35.086ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
79992025-01-06T20:38:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.973891ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
80002025-01-06T20:38:35.088ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80012025-01-06T20:38:35.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80022025-01-06T20:38:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80032025-01-06T20:38:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
80042025-01-06T20:38:35.088ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80052025-01-06T20:38:35.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80062025-01-06T20:38:35.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80072025-01-06T20:38:35.094ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
80082025-01-06T20:38:35.094ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
80092025-01-06T20:38:35.094ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
80102025-01-06T20:38:35.094ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80112025-01-06T20:38:35.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80122025-01-06T20:38:35.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
80132025-01-06T20:38:35.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
80142025-01-06T20:38:35.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80152025-01-06T20:38:35.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
80162025-01-06T20:38:35.108ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80172025-01-06T20:38:35.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80182025-01-06T20:38:35.112ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80192025-01-06T20:38:35.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80202025-01-06T20:38:35.119ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
80212025-01-06T20:38:35.119ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 132.130757ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
80222025-01-06T20:38:35.123ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 136.784613ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
80232025-01-06T20:38:35.128ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80242025-01-06T20:38:35.128ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80252025-01-06T20:38:35.128ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80262025-01-06T20:38:35.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80272025-01-06T20:38:35.153ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = ab59754a-77d3-4112-9295-21cb506c63bb file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
80282025-01-06T20:38:35.153ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80292025-01-06T20:38:35.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80302025-01-06T20:38:35.166ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80312025-01-06T20:38:35.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80322025-01-06T20:38:35.172ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
80332025-01-06T20:38:35.172ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80342025-01-06T20:38:35.173ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c450082-1fe4-4ac1-8aac-725879c41951", "content-length": "26", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
80352025-01-06T20:38:35.173ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80362025-01-06T20:38:35.175ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80372025-01-06T20:38:35.187ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
80382025-01-06T20:38:35.187ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80392025-01-06T20:38:35.187ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2034b56a-ce7d-4116-82b0-0394e9361489", "content-length": "26", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
80402025-01-06T20:38:35.187ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80412025-01-06T20:38:35.189ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80422025-01-06T20:38:35.205ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 217.735607ms iteration = 23 status = {"physical_disks_added":0}
80432025-01-06T20:38:35.214ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
80442025-01-06T20:38:35.214ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80452025-01-06T20:38:35.215ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe603d19-1c34-4233-b478-d37273c79694", "content-length": "26", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
80462025-01-06T20:38:35.217ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80472025-01-06T20:38:35.220ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
80482025-01-06T20:38:35.264ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
80492025-01-06T20:38:35.264ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
80502025-01-06T20:38:35.264ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80512025-01-06T20:38:35.265ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb27517e-bd47-4fd6-9c41-421dfdfbdaa6", "content-length": "372", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
80522025-01-06T20:38:35.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80532025-01-06T20:38:35.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80542025-01-06T20:38:35.266ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80552025-01-06T20:38:35.267ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80562025-01-06T20:38:35.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80572025-01-06T20:38:35.267ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80582025-01-06T20:38:35.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
80592025-01-06T20:38:35.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80602025-01-06T20:38:35.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80612025-01-06T20:38:35.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80622025-01-06T20:38:35.272ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80632025-01-06T20:38:35.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80642025-01-06T20:38:35.273ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80652025-01-06T20:38:35.275ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
80662025-01-06T20:38:35.275ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80672025-01-06T20:38:35.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80682025-01-06T20:38:35.277ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(7e8be350-5ca2-4536-bcca-fd8de98fc2d3, 0), (ffa138a1-a8e0-4499-a6c2-c943056e232d, 0), (f9d7eca9-cac7-4f29-aba6-001a637b69ad, 0)]
80692025-01-06T20:38:35.278ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1357, tv_nsec: 969137625 } })
80702025-01-06T20:38:35.278ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
80712025-01-06T20:38:35.279ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 292.431081ms iteration = 21 status = 0
80722025-01-06T20:38:35.329ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80732025-01-06T20:38:35.329ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
80742025-01-06T20:38:35.329ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
80752025-01-06T20:38:35.329ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80762025-01-06T20:38:35.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80772025-01-06T20:38:35.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80782025-01-06T20:38:35.332ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80792025-01-06T20:38:35.336ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
80802025-01-06T20:38:35.336ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 0 version = 2
80812025-01-06T20:38:35.336ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80822025-01-06T20:38:35.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80832025-01-06T20:38:35.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80842025-01-06T20:38:35.336ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80852025-01-06T20:38:35.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80862025-01-06T20:38:35.340ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80872025-01-06T20:38:35.340ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
80882025-01-06T20:38:35.340ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 353.459741ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
80892025-01-06T20:38:35.351ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-06T20:28:32.843602Z, time_modified: 2025-01-06T20:28:32.843602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }) }
80902025-01-06T20:38:35.351ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 364.500791ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]}},"default_endpoint":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
80912025-01-06T20:38:35.354ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
80922025-01-06T20:38:35.355ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
80932025-01-06T20:38:35.355ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-06 20:28:35.848690 UTC dns_group = internal generation = 1
80942025-01-06T20:38:35.355ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 368.244273ms iteration = 11 status = {"generation":1}
80952025-01-06T20:38:35.358ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
80962025-01-06T20:38:35.358ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
80972025-01-06T20:38:35.358ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7542fcf4-2152-45b0-9c03-128477befdd3", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
80982025-01-06T20:38:35.359ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80992025-01-06T20:38:35.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81002025-01-06T20:38:35.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81012025-01-06T20:38:35.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81022025-01-06T20:38:35.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81032025-01-06T20:38:35.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81042025-01-06T20:38:35.369ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81052025-01-06T20:38:35.369ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81062025-01-06T20:38:35.369ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5ba3e463-73a8-4775-b0d6-105fdb530df6", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81072025-01-06T20:38:35.372ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 385.324199ms iteration = 21 status = {}
81082025-01-06T20:38:35.372ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81092025-01-06T20:38:35.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
81102025-01-06T20:38:35.377ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81112025-01-06T20:38:35.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81122025-01-06T20:38:35.379ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81132025-01-06T20:38:35.379ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
81142025-01-06T20:38:35.379ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "147b4339-11c0-4a37-b043-1662020d0d6c", "content-length": "1", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81152025-01-06T20:38:35.381ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81162025-01-06T20:38:35.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81172025-01-06T20:38:35.381ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81182025-01-06T20:38:35.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81192025-01-06T20:38:35.390ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 404.150831ms iteration = 21 status = null
81202025-01-06T20:38:35.390ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81212025-01-06T20:38:35.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81222025-01-06T20:38:35.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81232025-01-06T20:38:35.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81242025-01-06T20:38:35.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81252025-01-06T20:38:35.393ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 407.019939ms iteration = 21 status = {}
81262025-01-06T20:38:35.393ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81272025-01-06T20:38:35.394ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 1 version = 2
81282025-01-06T20:38:35.394ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
81292025-01-06T20:38:35.394ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-06 20:28:37.181288 UTC dns_group = external generation = 2
81302025-01-06T20:38:35.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 407.224075ms iteration = 11 status = {"generation":2}
81312025-01-06T20:38:35.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81322025-01-06T20:38:35.397ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81332025-01-06T20:38:35.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81342025-01-06T20:38:35.398ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81352025-01-06T20:38:35.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81362025-01-06T20:38:35.421ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
81372025-01-06T20:38:35.421ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 434.044365ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
81382025-01-06T20:38:35.425ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81392025-01-06T20:38:35.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81402025-01-06T20:38:35.427ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81412025-01-06T20:38:35.429ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81422025-01-06T20:38:35.429ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81432025-01-06T20:38:35.429ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81442025-01-06T20:38:35.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81452025-01-06T20:38:35.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81462025-01-06T20:38:35.430ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81472025-01-06T20:38:35.431ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81482025-01-06T20:38:35.432ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81492025-01-06T20:38:35.432ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81502025-01-06T20:38:35.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81512025-01-06T20:38:35.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
81522025-01-06T20:38:35.434ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81532025-01-06T20:38:35.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81542025-01-06T20:38:35.436ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81552025-01-06T20:38:35.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81562025-01-06T20:38:35.438ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81572025-01-06T20:38:35.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81582025-01-06T20:38:35.441ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81592025-01-06T20:38:35.441ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
81602025-01-06T20:38:35.441ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
81612025-01-06T20:38:35.442ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
81622025-01-06T20:38:35.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81632025-01-06T20:38:35.442ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "4103ae6e-9413-4251-b208-b3ce6133cfbd", "content-length": "476", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81642025-01-06T20:38:35.442ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
81652025-01-06T20:38:35.442ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6387282d-7b30-418b-81d6-589f444ccd01", "content-length": "734", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81662025-01-06T20:38:35.442ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
81672025-01-06T20:38:35.443ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c373d2f-2e07-4bc7-9825-293979097143", "content-length": "111", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81682025-01-06T20:38:35.443ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
81692025-01-06T20:38:35.443ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "02721e90-e06c-43ca-89ac-ebb2548f223c", "content-length": "111", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81702025-01-06T20:38:35.443ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
81712025-01-06T20:38:35.443ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dc29e61-7a1c-47d5-8b37-ff24973eb4bc", "content-length": "167", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81722025-01-06T20:38:35.443ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
81732025-01-06T20:38:35.444ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "43a0690a-6775-4d87-ae71-de6fae237f66", "content-length": "167", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81742025-01-06T20:38:35.444ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
81752025-01-06T20:38:35.444ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81762025-01-06T20:38:35.444ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b3678cd-ad06-4bcb-9c6f-e6342c686b23", "content-length": "175", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81772025-01-06T20:38:35.444ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
81782025-01-06T20:38:35.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81792025-01-06T20:38:35.444ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "02b7b0e0-491c-4e79-8df7-c76b76d21822", "content-length": "175", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81802025-01-06T20:38:35.444ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
81812025-01-06T20:38:35.444ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8d55f83-0d70-41bd-90f0-513fa75408a3", "content-length": "702", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81822025-01-06T20:38:35.444ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
81832025-01-06T20:38:35.445ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "86a565a2-a411-4b03-aba6-6e28ed4abff1", "content-length": "727", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81842025-01-06T20:38:35.445ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
81852025-01-06T20:38:35.445ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5fbd37b-a362-4660-aa50-9e26832adcae", "content-length": "729", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81862025-01-06T20:38:35.445ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
81872025-01-06T20:38:35.445ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ae59955-695a-4d98-a46a-c9d29c636c64", "content-length": "728", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81882025-01-06T20:38:35.445ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
81892025-01-06T20:38:35.445ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7e349f5-0490-455d-bccd-42de542cd3b7", "content-length": "722", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81902025-01-06T20:38:35.445ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
81912025-01-06T20:38:35.445ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd2a0525-4321-4fef-be88-c16b4a0c00f7", "content-length": "109", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81922025-01-06T20:38:35.445ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
81932025-01-06T20:38:35.446ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "70b987e8-1400-4993-908a-1796c7400da5", "content-length": "109", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81942025-01-06T20:38:35.446ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
81952025-01-06T20:38:35.446ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2569243b-168f-4dda-94ee-47d0500dc85f", "content-length": "169", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81962025-01-06T20:38:35.446ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
81972025-01-06T20:38:35.446ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "64ef94dc-53e2-4067-9988-48a5fa5e62d5", "content-length": "169", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
81982025-01-06T20:38:35.446ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
81992025-01-06T20:38:35.447ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "eac13108-29e2-4927-afb4-5bccb383d23e", "content-length": "178", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
82002025-01-06T20:38:35.447ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
82012025-01-06T20:38:35.447ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "214988c5-1c7a-475e-9285-7ba1933008c2", "content-length": "178", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
82022025-01-06T20:38:35.447ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
82032025-01-06T20:38:35.447ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5dccee7-7b5b-4ec4-887b-660012ea11e6", "content-length": "702", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
82042025-01-06T20:38:35.447ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
82052025-01-06T20:38:35.447ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5d214ee-3e0d-49ef-893a-134206d931ab", "content-length": "727", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
82062025-01-06T20:38:35.447ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
82072025-01-06T20:38:35.447ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef768a49-ed8a-476b-aa85-3d356b89b941", "content-length": "729", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
82082025-01-06T20:38:35.447ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
82092025-01-06T20:38:35.448ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0124a2e-30d2-41df-aa82-35464371bacb", "content-length": "728", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
82102025-01-06T20:38:35.448ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
82112025-01-06T20:38:35.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
82122025-01-06T20:38:35.477ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82132025-01-06T20:38:35.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82142025-01-06T20:38:35.479ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82152025-01-06T20:38:35.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82162025-01-06T20:38:35.485ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82172025-01-06T20:38:35.490ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
82182025-01-06T20:38:35.490ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82192025-01-06T20:38:35.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82202025-01-06T20:38:35.491ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82212025-01-06T20:38:35.492ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82222025-01-06T20:38:35.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82232025-01-06T20:38:35.493ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
82242025-01-06T20:38:35.493ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
82252025-01-06T20:38:35.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
82262025-01-06T20:38:35.494ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82272025-01-06T20:38:35.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82282025-01-06T20:38:35.496ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82292025-01-06T20:38:35.500ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
82302025-01-06T20:38:35.500ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82312025-01-06T20:38:35.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82322025-01-06T20:38:35.505ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82332025-01-06T20:38:35.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82342025-01-06T20:38:35.507ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82352025-01-06T20:38:35.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82362025-01-06T20:38:35.510ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
82372025-01-06T20:38:35.511ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9121fa16-3573-4d7f-94fa-f3671e81da72", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
82382025-01-06T20:38:35.511ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
82392025-01-06T20:38:35.513ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d0190834-431f-4a19-ab12-db83f9426087", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
82402025-01-06T20:38:35.513ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
82412025-01-06T20:38:35.515ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
82422025-01-06T20:38:35.515ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 528.63855ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
82432025-01-06T20:38:35.522ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
82442025-01-06T20:38:35.531ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82452025-01-06T20:38:35.533ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
82462025-01-06T20:38:35.533ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
82472025-01-06T20:38:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
82482025-01-06T20:38:35.585ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
82492025-01-06T20:38:35.585ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "97d15442-5ed9-43c3-acc7-658fa349c6c8", "content-length": "691", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
82502025-01-06T20:38:35.585ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
82512025-01-06T20:38:35.585ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
82522025-01-06T20:38:35.585ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
82532025-01-06T20:38:35.587ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82542025-01-06T20:38:35.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82552025-01-06T20:38:35.588ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 600.846636ms iteration = 21 status = {}
82562025-01-06T20:38:35.589ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82572025-01-06T20:38:35.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82582025-01-06T20:38:35.592ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82592025-01-06T20:38:35.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82602025-01-06T20:38:35.594ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82612025-01-06T20:38:35.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82622025-01-06T20:38:35.595ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82632025-01-06T20:38:35.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82642025-01-06T20:38:35.604ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
82652025-01-06T20:38:35.605ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "21150312-145a-4131-9004-7a0ede91cc8a", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
82662025-01-06T20:38:35.605ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
82672025-01-06T20:38:35.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82682025-01-06T20:38:35.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82692025-01-06T20:38:35.606ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "855965e1-2d32-490a-a437-0cd197e1adf7", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
82702025-01-06T20:38:35.606ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
82712025-01-06T20:38:35.608ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "42bfe322-9dcc-471b-9000-920dc07b157d", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
82722025-01-06T20:38:35.608ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
82732025-01-06T20:38:35.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8c3a19a0-0b8f-4ef9-8e64-56f62a4e78c1 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
82742025-01-06T20:38:35.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8c3a19a0-0b8f-4ef9-8e64-56f62a4e78c1 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
82752025-01-06T20:38:35.610ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
82762025-01-06T20:38:35.610ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 623.78485ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
82772025-01-06T20:38:35.628ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
82782025-01-06T20:38:35.628ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
82792025-01-06T20:38:35.629ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82802025-01-06T20:38:35.630ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
82812025-01-06T20:38:35.630ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82822025-01-06T20:38:35.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82832025-01-06T20:38:35.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8c3a19a0-0b8f-4ef9-8e64-56f62a4e78c1 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
82842025-01-06T20:38:35.633ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
82852025-01-06T20:38:35.633ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82862025-01-06T20:38:35.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82872025-01-06T20:38:35.634ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82882025-01-06T20:38:35.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82892025-01-06T20:38:35.636ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82902025-01-06T20:38:35.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82912025-01-06T20:38:35.637ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82922025-01-06T20:38:35.640ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
82932025-01-06T20:38:35.640ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4abd803-fb41-4b54-a5bc-f18176b3d4b5", "content-length": "134", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
82942025-01-06T20:38:35.640ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
82952025-01-06T20:38:35.640ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
82962025-01-06T20:38:35.640ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
82972025-01-06T20:38:35.640ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
82982025-01-06T20:38:35.640ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82992025-01-06T20:38:35.640ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83002025-01-06T20:38:35.640ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83012025-01-06T20:38:35.640ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83022025-01-06T20:38:35.641ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83032025-01-06T20:38:35.641ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83042025-01-06T20:38:35.641ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
83052025-01-06T20:38:35.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83062025-01-06T20:38:35.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83072025-01-06T20:38:35.641ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
83082025-01-06T20:38:35.641ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83092025-01-06T20:38:35.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83102025-01-06T20:38:35.643ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
83112025-01-06T20:38:35.644ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd659391-50cb-4e28-9fa7-94a595f627ad", "content-length": "2", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
83122025-01-06T20:38:35.644ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
83132025-01-06T20:38:35.644ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "10e37487-0c65-40fe-971e-35342ca2758b", "content-length": "52", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
83142025-01-06T20:38:35.644ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
83152025-01-06T20:38:35.644ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
83162025-01-06T20:38:35.654ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 3625f012-ee30-4f98-8a1c-0af1461ec06d, kind: Service { id: 65bacdd1-9837-48ad-941c-aec5e2d79006 }, name: Name("external-dns-65bacdd1-9837-48ad-941c-aec5e2d79006"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4d552cc4-f760-463a-93c5-d2e30889777f, kind: Service { id: 66b4065d-0a65-4141-b8ec-3ce1f64a2d26 }, name: Name("external-dns-66b4065d-0a65-4141-b8ec-3ce1f64a2d26"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 4ce43e52-5d4e-4cdd-8eba-6b27829f964c, kind: Service { id: d4581482-c7a8-479c-a435-cf6d95b38f96 }, name: Name("nexus-d4581482-c7a8-479c-a435-cf6d95b38f96"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c82b60b3-cc02-4317-b01d-b79f84d25164, kind: Service { id: 0c1fb8d0-bed9-4de5-b5ae-b31f8c26aa7d }, name: Name("nexus-0c1fb8d0-bed9-4de5-b5ae-b31f8c26aa7d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eaad9b4b-165e-4563-bc83-588f65e0ba5a, kind: Service { id: e1810985-bbbe-481f-905f-91725e2502e7 }, name: Name("nexus-e1810985-bbbe-481f-905f-91725e2502e7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
83172025-01-06T20:38:35.654ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83182025-01-06T20:38:35.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83192025-01-06T20:38:35.656ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83202025-01-06T20:38:35.658ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
83212025-01-06T20:38:35.658ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83222025-01-06T20:38:35.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83232025-01-06T20:38:35.670ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
83242025-01-06T20:38:35.670ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3625f012-ee30-4f98-8a1c-0af1461ec06d, kind: Service { id: 65bacdd1-9837-48ad-941c-aec5e2d79006 }, name: Name("external-dns-65bacdd1-9837-48ad-941c-aec5e2d79006"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 174])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4d552cc4-f760-463a-93c5-d2e30889777f, kind: Service { id: 66b4065d-0a65-4141-b8ec-3ce1f64a2d26 }, name: Name("external-dns-66b4065d-0a65-4141-b8ec-3ce1f64a2d26"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4ce43e52-5d4e-4cdd-8eba-6b27829f964c, kind: Service { id: d4581482-c7a8-479c-a435-cf6d95b38f96 }, name: Name("nexus-d4581482-c7a8-479c-a435-cf6d95b38f96"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c82b60b3-cc02-4317-b01d-b79f84d25164, kind: Service { id: 0c1fb8d0-bed9-4de5-b5ae-b31f8c26aa7d }, name: Name("nexus-0c1fb8d0-bed9-4de5-b5ae-b31f8c26aa7d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 239])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: eaad9b4b-165e-4563-bc83-588f65e0ba5a, kind: Service { id: e1810985-bbbe-481f-905f-91725e2502e7 }, name: Name("nexus-e1810985-bbbe-481f-905f-91725e2502e7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
83252025-01-06T20:38:35.670ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
83262025-01-06T20:38:35.787ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "60684016-952d-4fc5-bd87-3413424962e1", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
83272025-01-06T20:38:35.787ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
83282025-01-06T20:38:35.787ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
83292025-01-06T20:38:35.792ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3aede266-47ec-465f-bba1-0016922ef7c8", "content-length": "682", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
83302025-01-06T20:38:35.792ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83312025-01-06T20:38:35.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83322025-01-06T20:38:35.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83332025-01-06T20:38:35.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83342025-01-06T20:38:35.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83352025-01-06T20:38:35.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83362025-01-06T20:38:35.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83372025-01-06T20:38:35.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83382025-01-06T20:38:35.812ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 346c1d3f-8af0-46bf-8798-77d7bb811a90, time_created: 2025-01-06T20:28:34.961221Z, time_modified: 2025-01-06T20:28:34.961221Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
83392025-01-06T20:38:35.812ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
83402025-01-06T20:38:35.812ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83412025-01-06T20:38:35.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83422025-01-06T20:38:35.814ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 827.424354ms iteration = 21 status = {}
83432025-01-06T20:38:35.816ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83442025-01-06T20:38:35.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83452025-01-06T20:38:35.819ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83462025-01-06T20:38:35.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
83472025-01-06T20:38:35.859ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
83482025-01-06T20:38:35.870ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "600b7d4d-0725-43df-8f4b-47bfb9968423", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
83492025-01-06T20:38:35.871ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
83502025-01-06T20:38:35.871ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 884.410024ms
83512025-01-06T20:38:35.871ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 884.420495ms iteration = 3 status = {}
83522025-01-06T20:38:36.072ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d7952f7-bdc3-453a-abd2-6bde9420f2ff", "content-length": "30797", "date": "Mon, 06 Jan 2025 20:38:35 GMT"} })
83532025-01-06T20:38:36.074ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
83542025-01-06T20:38:36.074ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
83552025-01-06T20:38:36.074ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
83562025-01-06T20:38:36.076ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
83572025-01-06T20:38:36.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
83582025-01-06T20:38:36.078ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83592025-01-06T20:38:36.079ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
83602025-01-06T20:38:36.079ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
83612025-01-06T20:38:36.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
83622025-01-06T20:38:36.250ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 6803687e-7b83-4868-9738-9c3361cb65a3 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
83632025-01-06T20:38:36.250ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 6803687e-7b83-4868-9738-9c3361cb65a3 time_started = 2025-01-06 20:38:35.441957 UTC
83642025-01-06T20:38:36.250ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.263477943s iteration = 3 status = {"collection_id":"6803687e-7b83-4868-9738-9c3361cb65a3","time_done":"2025-01-06 20:38:36.074482 UTC","time_started":"2025-01-06 20:38:35.441957 UTC"}
83652025-01-06T20:38:36.250ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
83662025-01-06T20:38:36.250ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83672025-01-06T20:38:36.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83682025-01-06T20:38:36.252ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83692025-01-06T20:38:36.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83702025-01-06T20:38:36.254ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83712025-01-06T20:38:36.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83722025-01-06T20:38:36.256ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83732025-01-06T20:38:36.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83742025-01-06T20:38:36.258ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83752025-01-06T20:38:36.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83762025-01-06T20:38:36.260ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83772025-01-06T20:38:36.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83782025-01-06T20:38:36.294ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 44.11228ms iteration = 24 status = {"physical_disks_added":0}
83792025-01-06T20:38:36.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d93e3b28-fb5c-47be-9eb6-2366ac4efb6a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83802025-01-06T20:38:36.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d93e3b28-fb5c-47be-9eb6-2366ac4efb6a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83812025-01-06T20:38:36.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d93e3b28-fb5c-47be-9eb6-2366ac4efb6a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83822025-01-06T20:38:37.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ef7b6ccd-c8a6-474f-9c57-81750c4970b5 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83832025-01-06T20:38:37.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ef7b6ccd-c8a6-474f-9c57-81750c4970b5 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83842025-01-06T20:38:37.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ef7b6ccd-c8a6-474f-9c57-81750c4970b5 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83852025-01-06T20:38:37.760ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 477 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = ebe31999-784a-4c81-b3fe-48152bcd3439 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
83862025-01-06T20:38:38.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 11311a32-22ce-44e9-a9ad-2c6f358aa022 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83872025-01-06T20:38:38.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 11311a32-22ce-44e9-a9ad-2c6f358aa022 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83882025-01-06T20:38:38.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 11311a32-22ce-44e9-a9ad-2c6f358aa022 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83892025-01-06T20:38:39.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 214677d2-cb1d-4f39-a7f0-013e851680a5 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83902025-01-06T20:38:39.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 214677d2-cb1d-4f39-a7f0-013e851680a5 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83912025-01-06T20:38:39.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2714 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 214677d2-cb1d-4f39-a7f0-013e851680a5 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83922025-01-06T20:38:40.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cf8d4bbc-dcd4-4edf-9c7f-061e5b7c706f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83932025-01-06T20:38:40.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cf8d4bbc-dcd4-4edf-9c7f-061e5b7c706f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83942025-01-06T20:38:40.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cf8d4bbc-dcd4-4edf-9c7f-061e5b7c706f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83952025-01-06T20:38:41.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 15ec1f7e-5d6e-4cec-a34b-8ce8238c5683 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83962025-01-06T20:38:41.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 15ec1f7e-5d6e-4cec-a34b-8ce8238c5683 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83972025-01-06T20:38:41.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 15ec1f7e-5d6e-4cec-a34b-8ce8238c5683 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83982025-01-06T20:38:42.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3560249e-cdee-482c-b511-725ba4e1ad42 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
83992025-01-06T20:38:42.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3560249e-cdee-482c-b511-725ba4e1ad42 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84002025-01-06T20:38:42.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3560249e-cdee-482c-b511-725ba4e1ad42 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84012025-01-06T20:38:43.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eec77c11-4898-41b1-bb6d-b8bdf2ca6f83 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84022025-01-06T20:38:43.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eec77c11-4898-41b1-bb6d-b8bdf2ca6f83 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84032025-01-06T20:38:43.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eec77c11-4898-41b1-bb6d-b8bdf2ca6f83 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84042025-01-06T20:38:44.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 708ef9c6-0ca0-42ff-8963-2a47a6836bde roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84052025-01-06T20:38:44.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 708ef9c6-0ca0-42ff-8963-2a47a6836bde resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84062025-01-06T20:38:44.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 708ef9c6-0ca0-42ff-8963-2a47a6836bde response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84072025-01-06T20:38:44.985ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
84082025-01-06T20:38:44.985ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84092025-01-06T20:38:44.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84102025-01-06T20:38:44.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84112025-01-06T20:38:44.987ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
84122025-01-06T20:38:44.987ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84132025-01-06T20:38:44.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84142025-01-06T20:38:44.989ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84152025-01-06T20:38:44.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84162025-01-06T20:38:44.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84172025-01-06T20:38:44.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84182025-01-06T20:38:44.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84192025-01-06T20:38:44.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84202025-01-06T20:38:44.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
84212025-01-06T20:38:44.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84222025-01-06T20:38:44.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84232025-01-06T20:38:45.006ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
84242025-01-06T20:38:45.006ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.880859ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
84252025-01-06T20:38:45.016ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84262025-01-06T20:38:45.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84272025-01-06T20:38:45.044ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.355881ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84282025-01-06T20:38:45.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f48e237f-718d-48ff-bead-be0c1a5382d8 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84292025-01-06T20:38:45.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f48e237f-718d-48ff-bead-be0c1a5382d8 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84302025-01-06T20:38:45.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f48e237f-718d-48ff-bead-be0c1a5382d8 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84312025-01-06T20:38:46.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ac87fb83-9350-4d56-a52f-be0d8fa53acf roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84322025-01-06T20:38:46.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ac87fb83-9350-4d56-a52f-be0d8fa53acf resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84332025-01-06T20:38:46.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ac87fb83-9350-4d56-a52f-be0d8fa53acf response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84342025-01-06T20:38:47.760ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 493 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 6df61f07-03e5-4cc9-8273-2a791a9f4e93 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
84352025-01-06T20:38:47.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f54b387c-6312-42f3-9c81-dff08af0c630 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84362025-01-06T20:38:47.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f54b387c-6312-42f3-9c81-dff08af0c630 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84372025-01-06T20:38:47.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f54b387c-6312-42f3-9c81-dff08af0c630 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84382025-01-06T20:38:48.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 341182b8-b9ae-47ae-b027-845adc05de95 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84392025-01-06T20:38:48.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 341182b8-b9ae-47ae-b027-845adc05de95 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84402025-01-06T20:38:48.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 341182b8-b9ae-47ae-b027-845adc05de95 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84412025-01-06T20:38:50.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f707baca-404e-469a-9d3b-b72d983ed087 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84422025-01-06T20:38:50.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f707baca-404e-469a-9d3b-b72d983ed087 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84432025-01-06T20:38:50.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f707baca-404e-469a-9d3b-b72d983ed087 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84442025-01-06T20:38:51.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bf9642e0-58da-4ff7-bd19-e54a48d427b1 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84452025-01-06T20:38:51.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bf9642e0-58da-4ff7-bd19-e54a48d427b1 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84462025-01-06T20:38:51.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bf9642e0-58da-4ff7-bd19-e54a48d427b1 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84472025-01-06T20:38:52.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c75d0015-5ef3-48cf-bda8-03f1857c53e4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84482025-01-06T20:38:52.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c75d0015-5ef3-48cf-bda8-03f1857c53e4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84492025-01-06T20:38:52.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c75d0015-5ef3-48cf-bda8-03f1857c53e4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84502025-01-06T20:38:53.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 113c2166-58bf-4534-bc0e-ae979e497558 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84512025-01-06T20:38:53.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 113c2166-58bf-4534-bc0e-ae979e497558 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84522025-01-06T20:38:53.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 113c2166-58bf-4534-bc0e-ae979e497558 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84532025-01-06T20:38:54.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 159e2f2c-15d4-407c-8c9c-36354e67064e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84542025-01-06T20:38:54.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 159e2f2c-15d4-407c-8c9c-36354e67064e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84552025-01-06T20:38:54.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 159e2f2c-15d4-407c-8c9c-36354e67064e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84562025-01-06T20:38:54.986ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
84572025-01-06T20:38:54.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84582025-01-06T20:38:54.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84592025-01-06T20:38:54.986ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
84602025-01-06T20:38:54.986ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84612025-01-06T20:38:54.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84622025-01-06T20:38:54.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84632025-01-06T20:38:54.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84642025-01-06T20:38:54.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84652025-01-06T20:38:54.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84662025-01-06T20:38:54.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84672025-01-06T20:38:54.990ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.040019ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84682025-01-06T20:38:54.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84692025-01-06T20:38:54.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84702025-01-06T20:38:54.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84712025-01-06T20:38:54.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84722025-01-06T20:38:54.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
84732025-01-06T20:38:54.995ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84742025-01-06T20:38:54.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84752025-01-06T20:38:55.007ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
84762025-01-06T20:38:55.007ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.96719ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
84772025-01-06T20:38:55.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6cc945bc-3bd4-4035-b768-40a999624d2f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84782025-01-06T20:38:55.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6cc945bc-3bd4-4035-b768-40a999624d2f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84792025-01-06T20:38:55.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6cc945bc-3bd4-4035-b768-40a999624d2f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84802025-01-06T20:38:56.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a59b0a39-b0fa-4dee-9155-9560778b397a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84812025-01-06T20:38:56.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a59b0a39-b0fa-4dee-9155-9560778b397a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84822025-01-06T20:38:56.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a59b0a39-b0fa-4dee-9155-9560778b397a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84832025-01-06T20:38:57.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c7e0481f-6168-4f5d-94be-06cf32ddcfa1 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84842025-01-06T20:38:57.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c7e0481f-6168-4f5d-94be-06cf32ddcfa1 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84852025-01-06T20:38:57.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2584 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c7e0481f-6168-4f5d-94be-06cf32ddcfa1 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84862025-01-06T20:38:57.759ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 628 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = c66f1545-9302-4677-b80b-883eae6bfbba response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
84872025-01-06T20:38:58.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0f62e2fd-9c22-46a4-b2f2-4377d08c640b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84882025-01-06T20:38:58.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0f62e2fd-9c22-46a4-b2f2-4377d08c640b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84892025-01-06T20:38:58.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0f62e2fd-9c22-46a4-b2f2-4377d08c640b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84902025-01-06T20:38:59.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0e9f8e09-402d-40e0-b554-93fca5046fd0 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84912025-01-06T20:38:59.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0e9f8e09-402d-40e0-b554-93fca5046fd0 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84922025-01-06T20:38:59.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0e9f8e09-402d-40e0-b554-93fca5046fd0 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84932025-01-06T20:39:00.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2f19a617-4386-4d16-b5fb-1fcc0b10096b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84942025-01-06T20:39:00.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2f19a617-4386-4d16-b5fb-1fcc0b10096b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84952025-01-06T20:39:00.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2f19a617-4386-4d16-b5fb-1fcc0b10096b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84962025-01-06T20:39:01.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4b172dc2-8e37-452e-8e49-b6d635c6e308 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84972025-01-06T20:39:01.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4b172dc2-8e37-452e-8e49-b6d635c6e308 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84982025-01-06T20:39:01.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4b172dc2-8e37-452e-8e49-b6d635c6e308 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
84992025-01-06T20:39:02.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 473971e3-148e-42c5-9398-be214ca788e3 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
85002025-01-06T20:39:02.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 473971e3-148e-42c5-9398-be214ca788e3 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
85012025-01-06T20:39:02.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 473971e3-148e-42c5-9398-be214ca788e3 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
85022025-01-06T20:39:02.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = ec98044f-f2ca-4f60-8c1d-b31f72ff2d40 roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
85032025-01-06T20:39:02.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = ec98044f-f2ca-4f60-8c1d-b31f72ff2d40 resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
85042025-01-06T20:39:02.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = ec98044f-f2ca-4f60-8c1d-b31f72ff2d40 response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
85052025-01-06T20:39:02.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 27ebe189-4655-4d61-9fe1-ee895cf690c7 roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
85062025-01-06T20:39:02.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 27ebe189-4655-4d61-9fe1-ee895cf690c7 resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
85072025-01-06T20:39:02.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:44194 req_id = 27ebe189-4655-4d61-9fe1-ee895cf690c7 response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
85082025-01-06T20:39:03.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7652f61d-eeff-4194-8c34-a69b2da1b11b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
85092025-01-06T20:39:03.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7652f61d-eeff-4194-8c34-a69b2da1b11b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
85102025-01-06T20:39:03.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7652f61d-eeff-4194-8c34-a69b2da1b11b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
85112025-01-06T20:39:04.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cfef4191-72c5-45de-b92e-e7c1344bfc0b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
85122025-01-06T20:39:04.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cfef4191-72c5-45de-b92e-e7c1344bfc0b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
85132025-01-06T20:39:04.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1709 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = cfef4191-72c5-45de-b92e-e7c1344bfc0b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
85142025-01-06T20:39:04.985ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
85152025-01-06T20:39:04.985ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
85162025-01-06T20:39:04.985ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
85172025-01-06T20:39:04.985ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
85182025-01-06T20:39:04.985ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85192025-01-06T20:39:04.985ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
85202025-01-06T20:39:04.985ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85212025-01-06T20:39:04.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
85222025-01-06T20:39:04.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85232025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85242025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
85252025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85262025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
85272025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85282025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
85292025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
85302025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
85312025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
85322025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85332025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85342025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
85352025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
85362025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
85372025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85382025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
85392025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
85402025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85412025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85422025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
85432025-01-06T20:39:04.986ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
85442025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
85452025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85462025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85472025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
85482025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85492025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
85502025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
85512025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85522025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85532025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
85542025-01-06T20:39:04.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85552025-01-06T20:39:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85562025-01-06T20:39:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
85572025-01-06T20:39:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85582025-01-06T20:39:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85592025-01-06T20:39:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85602025-01-06T20:39:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85612025-01-06T20:39:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85622025-01-06T20:39:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85632025-01-06T20:39:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85642025-01-06T20:39:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85652025-01-06T20:39:04.988ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1387, tv_nsec: 678957745 } })
85662025-01-06T20:39:04.988ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
85672025-01-06T20:39:04.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85682025-01-06T20:39:04.989ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1387, tv_nsec: 680104247 } })
85692025-01-06T20:39:04.989ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
85702025-01-06T20:39:04.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85712025-01-06T20:39:04.990ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.582385ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
85722025-01-06T20:39:04.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85732025-01-06T20:39:04.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85742025-01-06T20:39:04.992ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85752025-01-06T20:39:04.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85762025-01-06T20:39:04.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85772025-01-06T20:39:04.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85782025-01-06T20:39:04.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85792025-01-06T20:39:04.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
85802025-01-06T20:39:04.992ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85812025-01-06T20:39:04.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85822025-01-06T20:39:04.994ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85832025-01-06T20:39:04.995ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85842025-01-06T20:39:04.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85852025-01-06T20:39:04.997ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85862025-01-06T20:39:04.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
85872025-01-06T20:39:04.997ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85882025-01-06T20:39:04.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85892025-01-06T20:39:04.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85902025-01-06T20:39:05.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85912025-01-06T20:39:05.005ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1387, tv_nsec: 696362799 } })
85922025-01-06T20:39:05.005ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
85932025-01-06T20:39:05.005ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85942025-01-06T20:39:05.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85952025-01-06T20:39:05.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85962025-01-06T20:39:05.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85972025-01-06T20:39:05.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85982025-01-06T20:39:05.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85992025-01-06T20:39:05.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86002025-01-06T20:39:05.011ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86012025-01-06T20:39:05.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86022025-01-06T20:39:05.011ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86032025-01-06T20:39:05.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86042025-01-06T20:39:05.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86052025-01-06T20:39:05.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
86062025-01-06T20:39:05.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86072025-01-06T20:39:05.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86082025-01-06T20:39:05.015ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86092025-01-06T20:39:05.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86102025-01-06T20:39:05.016ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86112025-01-06T20:39:05.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86122025-01-06T20:39:05.018ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86132025-01-06T20:39:05.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86142025-01-06T20:39:05.028ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
86152025-01-06T20:39:05.028ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.903697ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
86162025-01-06T20:39:05.038ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.586175ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
86172025-01-06T20:39:05.039ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86182025-01-06T20:39:05.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86192025-01-06T20:39:05.041ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86202025-01-06T20:39:05.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86212025-01-06T20:39:05.044ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86222025-01-06T20:39:05.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86232025-01-06T20:39:05.046ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86242025-01-06T20:39:05.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
86252025-01-06T20:39:05.049ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86262025-01-06T20:39:05.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86272025-01-06T20:39:05.050ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.161656ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
86282025-01-06T20:39:05.051ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86292025-01-06T20:39:05.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86302025-01-06T20:39:05.053ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86312025-01-06T20:39:05.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86322025-01-06T20:39:05.054ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 67.878268ms iteration = 22 status = 0
86332025-01-06T20:39:05.059ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86342025-01-06T20:39:05.059ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
86352025-01-06T20:39:05.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86362025-01-06T20:39:05.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86372025-01-06T20:39:05.060ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86382025-01-06T20:39:05.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86392025-01-06T20:39:05.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86402025-01-06T20:39:05.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86412025-01-06T20:39:05.062ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86422025-01-06T20:39:05.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86432025-01-06T20:39:05.069ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
86442025-01-06T20:39:05.069ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.779903ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
86452025-01-06T20:39:05.090ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
86462025-01-06T20:39:05.090ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86472025-01-06T20:39:05.090ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "781c1808-77fe-496b-ba4b-bdb96959ee12", "content-length": "26", "date": "Mon, 06 Jan 2025 20:39:05 GMT"} })
86482025-01-06T20:39:05.090ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86492025-01-06T20:39:05.092ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 105.977255ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
86502025-01-06T20:39:05.093ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86512025-01-06T20:39:05.093ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
86522025-01-06T20:39:05.093ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86532025-01-06T20:39:05.093ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "15cfac94-699b-490c-bd66-e1011a391c18", "content-length": "26", "date": "Mon, 06 Jan 2025 20:39:05 GMT"} })
86542025-01-06T20:39:05.093ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86552025-01-06T20:39:05.095ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86562025-01-06T20:39:05.096ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86572025-01-06T20:39:05.096ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
86582025-01-06T20:39:05.096ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86592025-01-06T20:39:05.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86602025-01-06T20:39:05.097ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 110.909719ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86612025-01-06T20:39:05.097ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 110.962781ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86622025-01-06T20:39:05.103ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
86632025-01-06T20:39:05.103ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86642025-01-06T20:39:05.103ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "590b2cb5-404f-4603-8ec3-16d93864c625", "content-length": "26", "date": "Mon, 06 Jan 2025 20:39:05 GMT"} })
86652025-01-06T20:39:05.103ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86662025-01-06T20:39:05.105ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
86672025-01-06T20:39:05.109ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 122.35498ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86682025-01-06T20:39:05.139ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86692025-01-06T20:39:05.139ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
86702025-01-06T20:39:05.139ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 152.992585ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
86712025-01-06T20:39:05.158ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 172.156696ms iteration = 25 status = {"physical_disks_added":0}
86722025-01-06T20:39:05.176ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86732025-01-06T20:39:05.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86742025-01-06T20:39:05.178ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86752025-01-06T20:39:05.180ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86762025-01-06T20:39:05.180ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86772025-01-06T20:39:05.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86782025-01-06T20:39:05.182ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86792025-01-06T20:39:05.184ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86802025-01-06T20:39:05.184ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86812025-01-06T20:39:05.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86822025-01-06T20:39:05.242ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
86832025-01-06T20:39:05.242ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86842025-01-06T20:39:05.242ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "916d15c5-9b8d-488f-972b-69a739768ef3", "content-length": "372", "date": "Mon, 06 Jan 2025 20:39:05 GMT"} })
86852025-01-06T20:39:05.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86862025-01-06T20:39:05.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86872025-01-06T20:39:05.295ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
86882025-01-06T20:39:05.295ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
86892025-01-06T20:39:05.296ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e30eae33-45a1-4579-914f-ad2684d0538b", "date": "Mon, 06 Jan 2025 20:39:05 GMT"} })
86902025-01-06T20:39:05.296ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86912025-01-06T20:39:05.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86922025-01-06T20:39:05.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86932025-01-06T20:39:05.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86942025-01-06T20:39:05.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86952025-01-06T20:39:05.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86962025-01-06T20:39:05.306ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
86972025-01-06T20:39:05.306ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86982025-01-06T20:39:05.306ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "59737984-ac53-49e7-b757-838eafebabf8", "date": "Mon, 06 Jan 2025 20:39:05 GMT"} })
86992025-01-06T20:39:05.308ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 321.316396ms iteration = 22 status = {}
87002025-01-06T20:39:05.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0d3d41b9-712b-42b8-b78c-6c1dc29c0c7a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87012025-01-06T20:39:05.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0d3d41b9-712b-42b8-b78c-6c1dc29c0c7a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87022025-01-06T20:39:05.335ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
87032025-01-06T20:39:05.335ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 349.853583ms iteration = 22 status = {}
87042025-01-06T20:39:05.335ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ccdb1aa-f3de-4084-9e2e-c9e8633974fa", "content-length": "1", "date": "Mon, 06 Jan 2025 20:39:04 GMT"} })
87052025-01-06T20:39:05.336ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
87062025-01-06T20:39:05.336ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87072025-01-06T20:39:05.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87082025-01-06T20:39:05.337ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "869f8066-c2cc-45fd-8514-900a4f007c8e", "content-length": "691", "date": "Mon, 06 Jan 2025 20:39:05 GMT"} })
87092025-01-06T20:39:05.337ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
87102025-01-06T20:39:05.337ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
87112025-01-06T20:39:05.337ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
87122025-01-06T20:39:05.338ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 351.837068ms iteration = 22 status = {}
87132025-01-06T20:39:05.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0d3d41b9-712b-42b8-b78c-6c1dc29c0c7a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87142025-01-06T20:39:05.339ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 353.76276ms iteration = 22 status = null
87152025-01-06T20:39:05.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87162025-01-06T20:39:05.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87172025-01-06T20:39:05.391ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
87182025-01-06T20:39:05.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87192025-01-06T20:39:05.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87202025-01-06T20:39:05.401ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
87212025-01-06T20:39:05.401ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9bf0653-0d13-4d6a-bd74-410156f62707", "content-length": "134", "date": "Mon, 06 Jan 2025 20:39:04 GMT"} })
87222025-01-06T20:39:05.401ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
87232025-01-06T20:39:05.401ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
87242025-01-06T20:39:05.401ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
87252025-01-06T20:39:05.401ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
87262025-01-06T20:39:05.401ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87272025-01-06T20:39:05.401ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87282025-01-06T20:39:05.401ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87292025-01-06T20:39:05.401ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87302025-01-06T20:39:05.401ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87312025-01-06T20:39:05.401ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87322025-01-06T20:39:05.401ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
87332025-01-06T20:39:05.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87342025-01-06T20:39:05.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87352025-01-06T20:39:05.403ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
87362025-01-06T20:39:05.404ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a774c36-8694-4737-b4c5-c61563ef6f17", "content-length": "2", "date": "Mon, 06 Jan 2025 20:39:04 GMT"} })
87372025-01-06T20:39:05.404ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
87382025-01-06T20:39:05.404ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b981291f-5918-4f63-918c-85ea7a4607f7", "content-length": "52", "date": "Mon, 06 Jan 2025 20:39:04 GMT"} })
87392025-01-06T20:39:05.404ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
87402025-01-06T20:39:05.404ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
87412025-01-06T20:39:05.574ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "feac3945-fa17-4b2d-897a-cb7665665915", "date": "Mon, 06 Jan 2025 20:39:05 GMT"} })
87422025-01-06T20:39:05.574ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
87432025-01-06T20:39:05.574ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
87442025-01-06T20:39:05.577ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b7eb588-fef3-48bb-b663-a12d5e5b4657", "content-length": "682", "date": "Mon, 06 Jan 2025 20:39:05 GMT"} })
87452025-01-06T20:39:05.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87462025-01-06T20:39:05.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87472025-01-06T20:39:05.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87482025-01-06T20:39:05.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87492025-01-06T20:39:05.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87502025-01-06T20:39:05.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87512025-01-06T20:39:05.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87522025-01-06T20:39:05.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87532025-01-06T20:39:05.592ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 605.588894ms iteration = 22 status = {}
87542025-01-06T20:39:06.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 26c31626-69e4-4a65-8bbf-5a908f8b645d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87552025-01-06T20:39:06.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 26c31626-69e4-4a65-8bbf-5a908f8b645d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87562025-01-06T20:39:06.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 26c31626-69e4-4a65-8bbf-5a908f8b645d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87572025-01-06T20:39:07.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a4e4df5e-346c-4e4e-8624-f08faa74bb0a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87582025-01-06T20:39:07.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a4e4df5e-346c-4e4e-8624-f08faa74bb0a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87592025-01-06T20:39:07.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a4e4df5e-346c-4e4e-8624-f08faa74bb0a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87602025-01-06T20:39:07.760ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 560 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 0faf13ff-19de-4c4d-abf6-fe4722ddb840 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
87612025-01-06T20:39:08.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1b159212-8270-43e3-be1a-27710507752b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87622025-01-06T20:39:08.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1b159212-8270-43e3-be1a-27710507752b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87632025-01-06T20:39:08.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1b159212-8270-43e3-be1a-27710507752b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87642025-01-06T20:39:09.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d06952e9-2db2-4560-9302-922e0417b97b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87652025-01-06T20:39:09.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d06952e9-2db2-4560-9302-922e0417b97b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87662025-01-06T20:39:09.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d06952e9-2db2-4560-9302-922e0417b97b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87672025-01-06T20:39:10.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 71b217b9-b5eb-4cb8-9675-129782fe1601 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87682025-01-06T20:39:10.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 71b217b9-b5eb-4cb8-9675-129782fe1601 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87692025-01-06T20:39:10.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1792 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 71b217b9-b5eb-4cb8-9675-129782fe1601 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87702025-01-06T20:39:11.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0a530fc0-5e20-40a2-94d8-9d2b037c799f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87712025-01-06T20:39:11.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0a530fc0-5e20-40a2-94d8-9d2b037c799f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87722025-01-06T20:39:11.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0a530fc0-5e20-40a2-94d8-9d2b037c799f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87732025-01-06T20:39:12.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f81d2112-6360-40d5-b817-e21abfa6c892 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87742025-01-06T20:39:12.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f81d2112-6360-40d5-b817-e21abfa6c892 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87752025-01-06T20:39:12.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f81d2112-6360-40d5-b817-e21abfa6c892 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87762025-01-06T20:39:13.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 568ccac3-8d42-4790-93a1-e1e9a548746b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87772025-01-06T20:39:13.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 568ccac3-8d42-4790-93a1-e1e9a548746b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87782025-01-06T20:39:13.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2648 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 568ccac3-8d42-4790-93a1-e1e9a548746b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87792025-01-06T20:39:14.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2168ff6c-8325-453b-95d9-30679ebd6833 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87802025-01-06T20:39:14.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2168ff6c-8325-453b-95d9-30679ebd6833 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87812025-01-06T20:39:14.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2168ff6c-8325-453b-95d9-30679ebd6833 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
87822025-01-06T20:39:14.986ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
87832025-01-06T20:39:14.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87842025-01-06T20:39:14.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87852025-01-06T20:39:14.986ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
87862025-01-06T20:39:14.986ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87872025-01-06T20:39:14.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87882025-01-06T20:39:14.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87892025-01-06T20:39:14.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87902025-01-06T20:39:14.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87912025-01-06T20:39:14.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87922025-01-06T20:39:14.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87932025-01-06T20:39:14.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87942025-01-06T20:39:14.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87952025-01-06T20:39:14.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87962025-01-06T20:39:14.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87972025-01-06T20:39:14.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
87982025-01-06T20:39:14.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87992025-01-06T20:39:14.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88002025-01-06T20:39:15.008ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
88012025-01-06T20:39:15.008ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.944708ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
88022025-01-06T20:39:15.018ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.634081ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88032025-01-06T20:39:15.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b3423bd4-a2b5-4249-ba30-a7024b48ed39 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88042025-01-06T20:39:15.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b3423bd4-a2b5-4249-ba30-a7024b48ed39 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88052025-01-06T20:39:15.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b3423bd4-a2b5-4249-ba30-a7024b48ed39 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88062025-01-06T20:39:16.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d4c254d9-0cad-46f0-8a2e-88284d276ffd roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88072025-01-06T20:39:16.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d4c254d9-0cad-46f0-8a2e-88284d276ffd resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88082025-01-06T20:39:16.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d4c254d9-0cad-46f0-8a2e-88284d276ffd response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88092025-01-06T20:39:17.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8a1bbbb9-d7ae-4de9-b473-4656a7e915ed roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88102025-01-06T20:39:17.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8a1bbbb9-d7ae-4de9-b473-4656a7e915ed resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88112025-01-06T20:39:17.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8a1bbbb9-d7ae-4de9-b473-4656a7e915ed response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88122025-01-06T20:39:17.759ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 490 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 1e020db3-ace4-4569-939e-52b2aa6d5b1e response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
88132025-01-06T20:39:18.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d3e31c14-dc99-43fa-a806-77126741ecc4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88142025-01-06T20:39:18.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d3e31c14-dc99-43fa-a806-77126741ecc4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88152025-01-06T20:39:18.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d3e31c14-dc99-43fa-a806-77126741ecc4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88162025-01-06T20:39:19.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 67fd79e4-8c27-486a-88df-2630c4bc046f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88172025-01-06T20:39:19.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 67fd79e4-8c27-486a-88df-2630c4bc046f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88182025-01-06T20:39:19.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1808 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 67fd79e4-8c27-486a-88df-2630c4bc046f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88192025-01-06T20:39:20.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fe73adb5-277c-4f17-93e1-e8c3bceafb2b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88202025-01-06T20:39:20.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fe73adb5-277c-4f17-93e1-e8c3bceafb2b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88212025-01-06T20:39:20.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fe73adb5-277c-4f17-93e1-e8c3bceafb2b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88222025-01-06T20:39:21.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f0d2dc67-bef1-4b3d-9830-9be34b8e7173 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88232025-01-06T20:39:21.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f0d2dc67-bef1-4b3d-9830-9be34b8e7173 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88242025-01-06T20:39:21.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = f0d2dc67-bef1-4b3d-9830-9be34b8e7173 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88252025-01-06T20:39:22.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7a1bdc4d-8348-42f0-b8df-590151b64a90 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88262025-01-06T20:39:22.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7a1bdc4d-8348-42f0-b8df-590151b64a90 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88272025-01-06T20:39:22.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7a1bdc4d-8348-42f0-b8df-590151b64a90 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88282025-01-06T20:39:23.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1fde6fb4-580c-4792-85d2-7fa1b83c12c9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88292025-01-06T20:39:23.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1fde6fb4-580c-4792-85d2-7fa1b83c12c9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88302025-01-06T20:39:23.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1fde6fb4-580c-4792-85d2-7fa1b83c12c9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88312025-01-06T20:39:24.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 62bb70ef-2eff-4b3d-be15-25cfad7042c5 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88322025-01-06T20:39:24.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 62bb70ef-2eff-4b3d-be15-25cfad7042c5 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88332025-01-06T20:39:24.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 62bb70ef-2eff-4b3d-be15-25cfad7042c5 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88342025-01-06T20:39:24.986ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
88352025-01-06T20:39:24.986ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
88362025-01-06T20:39:24.986ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88372025-01-06T20:39:24.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88382025-01-06T20:39:24.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88392025-01-06T20:39:24.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88402025-01-06T20:39:24.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88412025-01-06T20:39:24.989ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88422025-01-06T20:39:24.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88432025-01-06T20:39:24.991ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.161091ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88442025-01-06T20:39:24.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88452025-01-06T20:39:24.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88462025-01-06T20:39:24.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88472025-01-06T20:39:24.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88482025-01-06T20:39:24.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88492025-01-06T20:39:24.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88502025-01-06T20:39:24.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
88512025-01-06T20:39:24.998ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88522025-01-06T20:39:24.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88532025-01-06T20:39:25.011ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
88542025-01-06T20:39:25.011ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.941809ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
88552025-01-06T20:39:25.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c513eb21-b53e-4603-8379-122829fe14aa roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88562025-01-06T20:39:25.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c513eb21-b53e-4603-8379-122829fe14aa resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88572025-01-06T20:39:25.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c513eb21-b53e-4603-8379-122829fe14aa response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88582025-01-06T20:39:26.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e878c009-8c39-46cb-865f-cf94f5a80047 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88592025-01-06T20:39:26.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e878c009-8c39-46cb-865f-cf94f5a80047 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88602025-01-06T20:39:26.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e878c009-8c39-46cb-865f-cf94f5a80047 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88612025-01-06T20:39:27.759ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 482 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = fc9f4563-2a6c-49b3-9cab-591e6534d926 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
88622025-01-06T20:39:27.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fa701bd0-fbea-452e-93ef-531fad095cc7 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88632025-01-06T20:39:27.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fa701bd0-fbea-452e-93ef-531fad095cc7 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88642025-01-06T20:39:27.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2652 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fa701bd0-fbea-452e-93ef-531fad095cc7 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88652025-01-06T20:39:28.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 35d242da-220d-4e73-98ce-0d99b40169a5 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88662025-01-06T20:39:28.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 35d242da-220d-4e73-98ce-0d99b40169a5 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88672025-01-06T20:39:28.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 35d242da-220d-4e73-98ce-0d99b40169a5 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88682025-01-06T20:39:29.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 953e4551-2877-42bc-a8cb-d061f02a9ae8 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88692025-01-06T20:39:29.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 953e4551-2877-42bc-a8cb-d061f02a9ae8 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88702025-01-06T20:39:29.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 953e4551-2877-42bc-a8cb-d061f02a9ae8 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88712025-01-06T20:39:30.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 92619571-3d9d-430d-9b2f-f946253bf75a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88722025-01-06T20:39:30.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 92619571-3d9d-430d-9b2f-f946253bf75a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88732025-01-06T20:39:30.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 92619571-3d9d-430d-9b2f-f946253bf75a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88742025-01-06T20:39:31.807ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 374387d3-bb3c-440d-9c60-4ad5e081205c uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-06T20:39:31.794958382Z }
88752025-01-06T20:39:31.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 374387d3-bb3c-440d-9c60-4ad5e081205c roles = RoleSet { roles: {} } uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
88762025-01-06T20:39:31.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 374387d3-bb3c-440d-9c60-4ad5e081205c resource = Database result = Ok(()) uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
88772025-01-06T20:39:31.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55320 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 374387d3-bb3c-440d-9c60-4ad5e081205c response_code = 204 uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
88782025-01-06T20:39:31.851ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c37b1e3d-d305-40a2-836f-fdc0bdc06eff uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-06T20:39:31.850846274Z }
88792025-01-06T20:39:31.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c37b1e3d-d305-40a2-836f-fdc0bdc06eff roles = RoleSet { roles: {} } uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
88802025-01-06T20:39:31.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c37b1e3d-d305-40a2-836f-fdc0bdc06eff resource = Database result = Ok(()) uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
88812025-01-06T20:39:31.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35478 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c37b1e3d-d305-40a2-836f-fdc0bdc06eff response_code = 204 uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
88822025-01-06T20:39:31.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2336aff3-cd6d-4187-b7a0-9a246730a5e1 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88832025-01-06T20:39:31.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2336aff3-cd6d-4187-b7a0-9a246730a5e1 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88842025-01-06T20:39:31.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2336aff3-cd6d-4187-b7a0-9a246730a5e1 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88852025-01-06T20:39:32.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1de44abf-6320-4538-8a44-f7dee6c7a42c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88862025-01-06T20:39:32.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1de44abf-6320-4538-8a44-f7dee6c7a42c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88872025-01-06T20:39:32.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1de44abf-6320-4538-8a44-f7dee6c7a42c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88882025-01-06T20:39:34.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2da8fc78-97fc-4c0e-90b8-772a93c47872 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88892025-01-06T20:39:34.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2da8fc78-97fc-4c0e-90b8-772a93c47872 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88902025-01-06T20:39:34.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2da8fc78-97fc-4c0e-90b8-772a93c47872 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
88912025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
88922025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
88932025-01-06T20:39:34.985ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-06 20:29:34.985275137 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
88942025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
88952025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
88962025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
88972025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
88982025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
88992025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
89002025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89012025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89022025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
89032025-01-06T20:39:34.985ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468
89042025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.44\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468"}
89052025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
89062025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
89072025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
89082025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89092025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
89102025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
89112025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89122025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
89132025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
89142025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89152025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
89162025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
89172025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89182025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
89192025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89202025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89212025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89222025-01-06T20:39:34.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89232025-01-06T20:39:34.986ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65bacdd1-9837-48ad-941c-aec5e2d79006.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1417, tv_nsec: 677236039 } })
89242025-01-06T20:39:34.986ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("88aaaee6-38b4-4a83-9c08-04f0ea18e003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8dd67555-06fb-4cef-b914-9650f0eeb68a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1417, tv_nsec: 677398753 } })
89252025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
89262025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89272025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
89282025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
89292025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89302025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
89312025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89322025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89332025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
89342025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
89352025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89362025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
89372025-01-06T20:39:34.986ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
89382025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
89392025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89402025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89412025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
89422025-01-06T20:39:34.986ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
89432025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
89442025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89452025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
89462025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89472025-01-06T20:39:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89482025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
89492025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89502025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89512025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
89522025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
89532025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
89542025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89552025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89562025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
89572025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89582025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
89592025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
89602025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
89612025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89622025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
89632025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89642025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
89652025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
89662025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
89672025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
89682025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89692025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89702025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89712025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
89722025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
89732025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
89742025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.572703ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
89752025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
89762025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.684006ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
89772025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
89782025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89792025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
89802025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
89812025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
89822025-01-06T20:39:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89832025-01-06T20:39:34.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89842025-01-06T20:39:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89852025-01-06T20:39:34.989ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-06 20:29:34.985275137 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
89862025-01-06T20:39:34.989ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.780233ms iteration = 12 status = {"expiration":"2025-01-06T20:29:34.985275137Z","pruned":[]}
89872025-01-06T20:39:34.989ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1417, tv_nsec: 680776225 } })
89882025-01-06T20:39:34.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89892025-01-06T20:39:34.989ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.39339ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
89902025-01-06T20:39:34.989ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
89912025-01-06T20:39:34.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89922025-01-06T20:39:34.990ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1417, tv_nsec: 681231408 } })
89932025-01-06T20:39:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89942025-01-06T20:39:34.990ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
89952025-01-06T20:39:34.990ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89962025-01-06T20:39:34.992ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89972025-01-06T20:39:34.992ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89982025-01-06T20:39:34.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89992025-01-06T20:39:34.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90002025-01-06T20:39:34.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90012025-01-06T20:39:34.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90022025-01-06T20:39:34.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90032025-01-06T20:39:34.996ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90042025-01-06T20:39:34.997ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90052025-01-06T20:39:34.998ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90062025-01-06T20:39:34.998ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90072025-01-06T20:39:34.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90082025-01-06T20:39:34.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
90092025-01-06T20:39:34.999ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90102025-01-06T20:39:34.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
90112025-01-06T20:39:35.001ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.774993ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
90122025-01-06T20:39:35.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
90132025-01-06T20:39:35.001ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90142025-01-06T20:39:35.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90152025-01-06T20:39:35.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90162025-01-06T20:39:35.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90172025-01-06T20:39:35.016ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90182025-01-06T20:39:35.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90192025-01-06T20:39:35.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90202025-01-06T20:39:35.022ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90212025-01-06T20:39:35.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90222025-01-06T20:39:35.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eb567b8c-e1ed-43e9-8936-56f01d1adbc4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
90232025-01-06T20:39:35.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eb567b8c-e1ed-43e9-8936-56f01d1adbc4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
90242025-01-06T20:39:35.025ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90252025-01-06T20:39:35.025ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90262025-01-06T20:39:35.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90272025-01-06T20:39:35.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90282025-01-06T20:39:35.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90292025-01-06T20:39:35.045ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90302025-01-06T20:39:35.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
90312025-01-06T20:39:35.049ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90322025-01-06T20:39:35.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90332025-01-06T20:39:35.059ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90342025-01-06T20:39:35.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90352025-01-06T20:39:35.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90362025-01-06T20:39:35.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = eb567b8c-e1ed-43e9-8936-56f01d1adbc4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
90372025-01-06T20:39:35.063ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90382025-01-06T20:39:35.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
90392025-01-06T20:39:35.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90402025-01-06T20:39:35.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90412025-01-06T20:39:35.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90422025-01-06T20:39:35.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90432025-01-06T20:39:35.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
90442025-01-06T20:39:35.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90452025-01-06T20:39:35.069ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90462025-01-06T20:39:35.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
90472025-01-06T20:39:35.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90482025-01-06T20:39:35.071ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90492025-01-06T20:39:35.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90502025-01-06T20:39:35.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
90512025-01-06T20:39:35.073ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
90522025-01-06T20:39:35.073ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90532025-01-06T20:39:35.073ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
90542025-01-06T20:39:35.073ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90552025-01-06T20:39:35.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
90562025-01-06T20:39:35.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90572025-01-06T20:39:35.074ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
90582025-01-06T20:39:35.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90592025-01-06T20:39:35.074ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90602025-01-06T20:39:35.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90612025-01-06T20:39:35.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90622025-01-06T20:39:35.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.91769ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90632025-01-06T20:39:35.076ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
90642025-01-06T20:39:35.076ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
90652025-01-06T20:39:35.076ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 89.340281ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
90662025-01-06T20:39:35.077ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 90.37124ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
90672025-01-06T20:39:35.077ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1417, tv_nsec: 769081269 } })
90682025-01-06T20:39:35.078ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
90692025-01-06T20:39:35.080ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.799844ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90702025-01-06T20:39:35.081ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90712025-01-06T20:39:35.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90722025-01-06T20:39:35.082ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90732025-01-06T20:39:35.082ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
90742025-01-06T20:39:35.082ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90752025-01-06T20:39:35.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90762025-01-06T20:39:35.083ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90772025-01-06T20:39:35.083ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90782025-01-06T20:39:35.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90792025-01-06T20:39:35.084ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
90802025-01-06T20:39:35.084ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
90812025-01-06T20:39:35.084ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
90822025-01-06T20:39:35.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90832025-01-06T20:39:35.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90842025-01-06T20:39:35.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90852025-01-06T20:39:35.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 98.433689ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
90862025-01-06T20:39:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90872025-01-06T20:39:35.086ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90882025-01-06T20:39:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90892025-01-06T20:39:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90902025-01-06T20:39:35.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90912025-01-06T20:39:35.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90922025-01-06T20:39:35.094ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90932025-01-06T20:39:35.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
90942025-01-06T20:39:35.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90952025-01-06T20:39:35.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90962025-01-06T20:39:35.101ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
90972025-01-06T20:39:35.101ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 115.257607ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
90982025-01-06T20:39:35.102ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 116.376618ms iteration = 23 status = 0
90992025-01-06T20:39:35.103ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
91002025-01-06T20:39:35.103ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91012025-01-06T20:39:35.104ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "565114be-18df-4df8-9b59-c24da350cc0d", "content-length": "26", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} })
91022025-01-06T20:39:35.104ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91032025-01-06T20:39:35.106ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91042025-01-06T20:39:35.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91052025-01-06T20:39:35.106ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91062025-01-06T20:39:35.109ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 122.588077ms iteration = 26 status = {"physical_disks_added":0}
91072025-01-06T20:39:35.122ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
91082025-01-06T20:39:35.126ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
91092025-01-06T20:39:35.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
91102025-01-06T20:39:35.126ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
91112025-01-06T20:39:35.126ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91122025-01-06T20:39:35.127ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50be6803-6900-4d17-89e6-5ffaa6369031", "content-length": "26", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} })
91132025-01-06T20:39:35.127ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91142025-01-06T20:39:35.128ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91152025-01-06T20:39:35.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91162025-01-06T20:39:35.130ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91172025-01-06T20:39:35.134ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91182025-01-06T20:39:35.136ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
91192025-01-06T20:39:35.136ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91202025-01-06T20:39:35.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91212025-01-06T20:39:35.136ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 150.23854ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91222025-01-06T20:39:35.139ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
91232025-01-06T20:39:35.139ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
91242025-01-06T20:39:35.139ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 153.160539ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
91252025-01-06T20:39:35.142ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
91262025-01-06T20:39:35.142ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
91272025-01-06T20:39:35.142ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 156.51697ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
91282025-01-06T20:39:35.143ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
91292025-01-06T20:39:35.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
91302025-01-06T20:39:35.153ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91312025-01-06T20:39:35.157ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91322025-01-06T20:39:35.157ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91332025-01-06T20:39:35.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91342025-01-06T20:39:35.158ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
91352025-01-06T20:39:35.158ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
91362025-01-06T20:39:35.158ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
91372025-01-06T20:39:35.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91382025-01-06T20:39:35.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91392025-01-06T20:39:35.158ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
91402025-01-06T20:39:35.160ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91412025-01-06T20:39:35.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
91422025-01-06T20:39:35.164ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91432025-01-06T20:39:35.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91442025-01-06T20:39:35.167ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91452025-01-06T20:39:35.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91462025-01-06T20:39:35.169ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91472025-01-06T20:39:35.171ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91482025-01-06T20:39:35.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91492025-01-06T20:39:35.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91502025-01-06T20:39:35.174ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91512025-01-06T20:39:35.175ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91522025-01-06T20:39:35.175ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91532025-01-06T20:39:35.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91542025-01-06T20:39:35.177ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 190.767763ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
91552025-01-06T20:39:35.193ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-06T20:28:32.843602Z, time_modified: 2025-01-06T20:28:32.843602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
91562025-01-06T20:39:35.193ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 208.526476ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]}},"default_endpoint":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
91572025-01-06T20:39:35.204ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
91582025-01-06T20:39:35.204ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 0 version = 2
91592025-01-06T20:39:35.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91602025-01-06T20:39:35.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91612025-01-06T20:39:35.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91622025-01-06T20:39:35.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91632025-01-06T20:39:35.210ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91642025-01-06T20:39:35.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91652025-01-06T20:39:35.224ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
91662025-01-06T20:39:35.224ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
91672025-01-06T20:39:35.224ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91682025-01-06T20:39:35.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91692025-01-06T20:39:35.252ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
91702025-01-06T20:39:35.252ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 265.545419ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
91712025-01-06T20:39:35.295ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200/state
91722025-01-06T20:39:35.295ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "92a54527-21e8-4172-99fd-3710186a2dc0", "content-length": "130", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} })
91732025-01-06T20:39:35.295ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 sled_id = 346c1d3f-8af0-46bf-8798-77d7bb811a90 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-06T20:39:31.850846274Z }, migration_in: None, migration_out: None } vmm_id = 87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
91742025-01-06T20:39:35.295ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2077 instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 sled_id = 346c1d3f-8af0-46bf-8798-77d7bb811a90 vmm_id = 87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-06T20:39:31.850846274Z }
91752025-01-06T20:39:35.295ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 roles = RoleSet { roles: {} } sled_id = 346c1d3f-8af0-46bf-8798-77d7bb811a90 vmm_id = 87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
91762025-01-06T20:39:35.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 resource = Database result = Ok(()) sled_id = 346c1d3f-8af0-46bf-8798-77d7bb811a90 vmm_id = 87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
91772025-01-06T20:39:35.329ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
91782025-01-06T20:39:35.329ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91792025-01-06T20:39:35.329ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a3c29c1-9607-4c97-97c2-4cf502ba1958", "content-length": "26", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} })
91802025-01-06T20:39:35.329ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91812025-01-06T20:39:35.332ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
91822025-01-06T20:39:35.365ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
91832025-01-06T20:39:35.366ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d589901f-f57b-49cd-a415-3313b07eda16", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91842025-01-06T20:39:35.366ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91852025-01-06T20:39:35.368ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f427239c-bef6-4190-80ce-07e24e8bea9a", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91862025-01-06T20:39:35.368ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91872025-01-06T20:39:35.369ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91882025-01-06T20:39:35.369ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 384.6404ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
91892025-01-06T20:39:35.395ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
91902025-01-06T20:39:35.398ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 412.958121ms iteration = 23 status = {}
91912025-01-06T20:39:35.418ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
91922025-01-06T20:39:35.419ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "01d6cb76-a589-4207-841b-43633ac3577c", "content-length": "1", "date": "Mon, 06 Jan 2025 20:39:34 GMT"} })
91932025-01-06T20:39:35.420ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91942025-01-06T20:39:35.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
91952025-01-06T20:39:35.485ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
91962025-01-06T20:39:35.486ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7c06d27-1d9c-4688-85b0-553eee5296ab", "content-length": "811", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} })
91972025-01-06T20:39:35.486ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(16029411) }} sled = sock
91982025-01-06T20:39:35.486ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
91992025-01-06T20:39:35.486ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
92002025-01-06T20:39:35.487ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 500.955746ms iteration = 23 status = {}
92012025-01-06T20:39:35.518ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
92022025-01-06T20:39:35.518ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92032025-01-06T20:39:35.518ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c0d3cab-fb36-457b-a791-fcab6ce732c9", "content-length": "585", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} })
92042025-01-06T20:39:35.518ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92052025-01-06T20:39:35.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92062025-01-06T20:39:35.521ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92072025-01-06T20:39:35.521ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 1 version = 2
92082025-01-06T20:39:35.521ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
92092025-01-06T20:39:35.521ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-06 20:28:37.181288 UTC dns_group = external generation = 2
92102025-01-06T20:39:35.521ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 535.878666ms iteration = 12 status = {"generation":2}
92112025-01-06T20:39:35.522ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 536.998318ms iteration = 23 status = null
92122025-01-06T20:39:35.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
92132025-01-06T20:39:35.524ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92142025-01-06T20:39:35.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92152025-01-06T20:39:35.526ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
92162025-01-06T20:39:35.526ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
92172025-01-06T20:39:35.526ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-06 20:28:35.848690 UTC dns_group = internal generation = 1
92182025-01-06T20:39:35.526ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 541.266934ms iteration = 12 status = {"generation":1}
92192025-01-06T20:39:35.540ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
92202025-01-06T20:39:35.540ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "089e31a7-bb27-4658-b0ad-e1988ae9b1d5", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92212025-01-06T20:39:35.540ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92222025-01-06T20:39:35.542ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f98cb243-4ef0-471c-98d3-64f783d75e90", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92232025-01-06T20:39:35.542ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92242025-01-06T20:39:35.545ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ef09e509-9a59-47ff-bd69-1f9083a4f4df", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92252025-01-06T20:39:35.545ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92262025-01-06T20:39:35.546ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {e1fb51c3-cec2-4cd7-b330-82d8dfdcd738: {10.151.2.176: {202361a5-afb9-4390-be68-15e4e34508e0}, 10.151.2.175: {202361a5-afb9-4390-be68-15e4e34508e0}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
92272025-01-06T20:39:35.546ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
92282025-01-06T20:39:35.547ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "11ea561b-fd7a-456c-a01c-2b51d9882345", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} })
92292025-01-06T20:39:35.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92302025-01-06T20:39:35.547ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
92312025-01-06T20:39:35.547ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 561.921116ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
92322025-01-06T20:39:35.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92332025-01-06T20:39:35.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92342025-01-06T20:39:35.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92352025-01-06T20:39:35.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92362025-01-06T20:39:35.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92372025-01-06T20:39:35.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92382025-01-06T20:39:35.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92392025-01-06T20:39:35.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92402025-01-06T20:39:35.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92412025-01-06T20:39:35.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92422025-01-06T20:39:35.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92432025-01-06T20:39:35.563ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
92442025-01-06T20:39:35.564ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
92452025-01-06T20:39:35.564ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
92462025-01-06T20:39:35.565ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92472025-01-06T20:39:35.565ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "65a68b9e-494c-49c1-a14a-98a5e10c2e2f", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} })
92482025-01-06T20:39:35.566ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 579.923815ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
92492025-01-06T20:39:35.567ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 580.862392ms iteration = 23 status = {}
92502025-01-06T20:39:35.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92512025-01-06T20:39:35.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92522025-01-06T20:39:35.582ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
92532025-01-06T20:39:35.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92542025-01-06T20:39:35.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92552025-01-06T20:39:35.593ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
92562025-01-06T20:39:35.593ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a286c42-567b-4ebc-8c80-67ec7ab83e17", "content-length": "134", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} })
92572025-01-06T20:39:35.593ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
92582025-01-06T20:39:35.593ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
92592025-01-06T20:39:35.594ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
92602025-01-06T20:39:35.594ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
92612025-01-06T20:39:35.594ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
92622025-01-06T20:39:35.594ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
92632025-01-06T20:39:35.594ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
92642025-01-06T20:39:35.594ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
92652025-01-06T20:39:35.594ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
92662025-01-06T20:39:35.594ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
92672025-01-06T20:39:35.594ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
92682025-01-06T20:39:35.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92692025-01-06T20:39:35.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92702025-01-06T20:39:35.596ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
92712025-01-06T20:39:35.596ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a37be0c-e45f-48e2-9396-09ebc264e103", "content-length": "2", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} })
92722025-01-06T20:39:35.596ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
92732025-01-06T20:39:35.596ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f527c63c-a65a-464a-b8e4-2fa9fa759afa", "content-length": "52", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} })
92742025-01-06T20:39:35.596ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
92752025-01-06T20:39:35.596ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
92762025-01-06T20:39:35.749ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
92772025-01-06T20:39:35.749ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
92782025-01-06T20:39:35.781ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
92792025-01-06T20:39:35.781ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:38208
92802025-01-06T20:39:35.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38208 req_id = 38d7ffb6-7aba-4891-ad9b-e0bf6d560399 roles = RoleSet { roles: {} } uri = /metrics/producers
92812025-01-06T20:39:35.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38208 req_id = 38d7ffb6-7aba-4891-ad9b-e0bf6d560399 resource = Database result = Ok(()) uri = /metrics/producers
92822025-01-06T20:39:35.808ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "08a786d9-7520-40f5-942a-a4f5af0844d5", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} })
92832025-01-06T20:39:35.808ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
92842025-01-06T20:39:35.808ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
92852025-01-06T20:39:35.813ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f4f929a-cb99-42f6-9bee-6af835bc2fe3", "content-length": "682", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} })
92862025-01-06T20:39:35.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92872025-01-06T20:39:35.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92882025-01-06T20:39:35.817ZINFOnexus: assigned collector to new producer collector_id = 3aa155a2-91f9-44a1-9f26-4a40e0aef546 file = nexus/src/app/oximeter.rs:76 producer_id = d4581482-c7a8-479c-a435-cf6d95b38f96
92892025-01-06T20:39:35.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35726 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38208 req_id = 38d7ffb6-7aba-4891-ad9b-e0bf6d560399 response_code = 201 uri = /metrics/producers
92902025-01-06T20:39:35.817ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "38d7ffb6-7aba-4891-ad9b-e0bf6d560399", "content-length": "41", "date": "Mon, 06 Jan 2025 20:39:35 GMT"} })
92912025-01-06T20:39:35.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92922025-01-06T20:39:35.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92932025-01-06T20:39:35.820ZDEBGnexus (producer-registration-task): registered with nexus successfully
92942025-01-06T20:39:35.820ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
92952025-01-06T20:39:35.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92962025-01-06T20:39:35.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92972025-01-06T20:39:35.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92982025-01-06T20:39:35.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92992025-01-06T20:39:35.834ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 847.893241ms iteration = 23 status = {}
93002025-01-06T20:39:36.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3247391d-3dad-4aae-a1ab-a5cfba14a3f9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93012025-01-06T20:39:36.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3247391d-3dad-4aae-a1ab-a5cfba14a3f9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93022025-01-06T20:39:36.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3247391d-3dad-4aae-a1ab-a5cfba14a3f9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93032025-01-06T20:39:37.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 31d21347-a20d-4505-8e8b-2e215ed53f94 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93042025-01-06T20:39:37.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 31d21347-a20d-4505-8e8b-2e215ed53f94 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93052025-01-06T20:39:37.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2732 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 31d21347-a20d-4505-8e8b-2e215ed53f94 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93062025-01-06T20:39:37.759ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 667 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 362b721b-cad0-4018-9855-cd5f033e9d6f response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
93072025-01-06T20:39:38.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 55b3ae97-93b3-4ba9-a634-7f09ed5d6f5d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93082025-01-06T20:39:38.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 55b3ae97-93b3-4ba9-a634-7f09ed5d6f5d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93092025-01-06T20:39:38.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 55b3ae97-93b3-4ba9-a634-7f09ed5d6f5d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93102025-01-06T20:39:39.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c736c423-c693-4b86-9066-2f1522c082d0 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93112025-01-06T20:39:39.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c736c423-c693-4b86-9066-2f1522c082d0 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93122025-01-06T20:39:39.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c736c423-c693-4b86-9066-2f1522c082d0 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93132025-01-06T20:39:40.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 17094ca3-23a9-4391-afd5-ce83ed2375f4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93142025-01-06T20:39:40.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 17094ca3-23a9-4391-afd5-ce83ed2375f4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93152025-01-06T20:39:40.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 17094ca3-23a9-4391-afd5-ce83ed2375f4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93162025-01-06T20:39:41.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3cedce35-b384-488d-b402-b30b2307730e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93172025-01-06T20:39:41.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3cedce35-b384-488d-b402-b30b2307730e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93182025-01-06T20:39:41.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3cedce35-b384-488d-b402-b30b2307730e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93192025-01-06T20:39:41.929ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 remote_addr = [fd00:1122:3344:101::1]:40048 req_id = de33dbdd-9b35-49f7-b774-048b4d6da672 uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-06T20:39:41.928875990Z }
93202025-01-06T20:39:41.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = de33dbdd-9b35-49f7-b774-048b4d6da672 roles = RoleSet { roles: {} } uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93212025-01-06T20:39:41.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = de33dbdd-9b35-49f7-b774-048b4d6da672 resource = Database result = Ok(()) uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93222025-01-06T20:39:41.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37586 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = de33dbdd-9b35-49f7-b774-048b4d6da672 response_code = 204 uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93232025-01-06T20:39:42.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 23ac125d-8426-4868-9d31-cb69626be0ff roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93242025-01-06T20:39:42.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 23ac125d-8426-4868-9d31-cb69626be0ff resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93252025-01-06T20:39:42.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 23ac125d-8426-4868-9d31-cb69626be0ff response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93262025-01-06T20:39:43.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 646acd65-1da4-4374-aea8-bca0005c7d3b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93272025-01-06T20:39:43.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 646acd65-1da4-4374-aea8-bca0005c7d3b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93282025-01-06T20:39:43.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 646acd65-1da4-4374-aea8-bca0005c7d3b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93292025-01-06T20:39:44.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 59d037ee-a942-4bc3-8d47-9ef0f18878c0 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93302025-01-06T20:39:44.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 59d037ee-a942-4bc3-8d47-9ef0f18878c0 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93312025-01-06T20:39:44.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 59d037ee-a942-4bc3-8d47-9ef0f18878c0 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
93322025-01-06T20:39:44.346ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-06T20:39:44.346610333Z }
93332025-01-06T20:39:44.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 roles = RoleSet { roles: {} } uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93342025-01-06T20:39:44.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 resource = Database result = Ok(()) uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93352025-01-06T20:39:44.355ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 vmm_needs_update = true
93362025-01-06T20:39:44.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 roles = RoleSet { roles: {} } uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93372025-01-06T20:39:44.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 resource = Database result = Ok(()) uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93382025-01-06T20:39:44.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 roles = RoleSet { roles: {} } uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93392025-01-06T20:39:44.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 resource = Database result = Ok(()) uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93402025-01-06T20:39:44.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 roles = RoleSet { roles: {} } uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93412025-01-06T20:39:44.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 resource = Database result = Ok(()) uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93422025-01-06T20:39:44.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 roles = RoleSet { roles: {} } uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93432025-01-06T20:39:44.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 resource = Database result = Ok(()) uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93442025-01-06T20:39:44.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 roles = RoleSet { roles: {} } uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93452025-01-06T20:39:44.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 resource = Database result = Ok(()) uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93462025-01-06T20:39:44.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 roles = RoleSet { roles: {} } uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93472025-01-06T20:39:44.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 resource = Database result = Ok(()) uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93482025-01-06T20:39:44.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93492025-01-06T20:39:44.370ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ccee3cb9-85e2-4135-9e23-45c41afea236, lookup_type: ById(ccee3cb9-85e2-4135-9e23-45c41afea236) }, key: fd5c27b2-8ae1-4307-8322-c553e5d585f6, lookup_type: ById(fd5c27b2-8ae1-4307-8322-c553e5d585f6) }, key: 3bde1b6c-87a2-46cb-a844-f287d6d62a70, lookup_type: ById(3bde1b6c-87a2-46cb-a844-f287d6d62a70) } result = Ok(()) uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93502025-01-06T20:39:44.375ZINFOnexus (dropshot_internal): starting update saga for 3bde1b6c-87a2-46cb-a844-f287d6d62a70 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1544 instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-06T20:39:44.346610333Z }
93512025-01-06T20:39:44.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28434 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 response_code = 204 uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93522025-01-06T20:39:44.375ZDEBGnexus (dropshot_internal): preparing instance-update saga for 3bde1b6c-87a2-46cb-a844-f287d6d62a70... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4debf48b-d5ba-4dce-83a1-0173f2f1e7b6 uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93532025-01-06T20:39:44.375ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update
93542025-01-06T20:39:44.375ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7a870c07-b3aa-41b2-8ebb-5d58f9949475 uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-06T20:39:44.346610333Z }
93552025-01-06T20:39:44.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7a870c07-b3aa-41b2-8ebb-5d58f9949475 roles = RoleSet { roles: {} } uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93562025-01-06T20:39:44.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7a870c07-b3aa-41b2-8ebb-5d58f9949475 resource = Database result = Ok(()) uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93572025-01-06T20:39:44.379ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"3bde1b6c-87a2-46cb-a844-f287d6d62a70","lookup_type":{"ById":"3bde1b6c-87a2-46cb-a844-f287d6d62a70"},"parent":{"key":"fd5c27b2-8ae1-4307-8322-c553e5d585f6","lookup_type":{"ById":"fd5c27b2-8ae1-4307-8322-c553e5d585f6"},"parent":{"key":"ccee3cb9-85e2-4135-9e23-45c41afea236","lookup_type":{"ById":"ccee3cb9-85e2-4135-9e23-45c41afea236"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
93582025-01-06T20:39:44.379ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update
93592025-01-06T20:39:44.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28671 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7a870c07-b3aa-41b2-8ebb-5d58f9949475 response_code = 204 uri = /vmms/87531b6c-ba3d-4f5c-a16b-8ae0e8efa200
93602025-01-06T20:39:44.421ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update
93612025-01-06T20:39:44.421ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
93622025-01-06T20:39:44.421ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
93632025-01-06T20:39:44.424ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1
93642025-01-06T20:39:44.428ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
93652025-01-06T20:39:44.428ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1
93662025-01-06T20:39:44.431ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
93672025-01-06T20:39:44.431ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1
93682025-01-06T20:39:44.442ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
93692025-01-06T20:39:44.442ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("19099102-c5b5-4f21-b9b0-642d1481b209")) node_id = 0 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1
93702025-01-06T20:39:44.445ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
93712025-01-06T20:39:44.445ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1
93722025-01-06T20:39:44.456ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update
93732025-01-06T20:39:44.460ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93742025-01-06T20:39:44.460ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93752025-01-06T20:39:44.463ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93762025-01-06T20:39:44.463ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93772025-01-06T20:39:44.465ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93782025-01-06T20:39:44.465ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93792025-01-06T20:39:44.472ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93802025-01-06T20:39:44.472ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93812025-01-06T20:39:44.473ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93822025-01-06T20:39:44.473ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93832025-01-06T20:39:44.475ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93842025-01-06T20:39:44.475ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93852025-01-06T20:39:44.476ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93862025-01-06T20:39:44.482ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ccee3cb9-85e2-4135-9e23-45c41afea236, lookup_type: ById(ccee3cb9-85e2-4135-9e23-45c41afea236) }, key: fd5c27b2-8ae1-4307-8322-c553e5d585f6, lookup_type: ById(fd5c27b2-8ae1-4307-8322-c553e5d585f6) }, key: 3bde1b6c-87a2-46cb-a844-f287d6d62a70, lookup_type: ById(3bde1b6c-87a2-46cb-a844-f287d6d62a70) } result = Ok(()) saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93872025-01-06T20:39:44.482ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance updater_id = 19099102-c5b5-4f21-b9b0-642d1481b209
93882025-01-06T20:39:44.482ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93892025-01-06T20:39:44.483ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93902025-01-06T20:39:44.496ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance updater_id = 19099102-c5b5-4f21-b9b0-642d1481b209
93912025-01-06T20:39:44.496ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93922025-01-06T20:39:44.496ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance
93932025-01-06T20:39:44.500ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 locked_gen = Generation(Generation(2)) saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = LockInstance updater_id = 19099102-c5b5-4f21-b9b0-642d1481b209
93942025-01-06T20:39:44.502ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
93952025-01-06T20:39:44.502ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("19099102-c5b5-4f21-b9b0-642d1481b209")}) node_id = 1 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1
93962025-01-06T20:39:44.506ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
93972025-01-06T20:39:44.506ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1
93982025-01-06T20:39:44.512ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
93992025-01-06T20:39:44.512ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94002025-01-06T20:39:44.513ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94012025-01-06T20:39:44.513ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94022025-01-06T20:39:44.514ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94032025-01-06T20:39:44.514ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94042025-01-06T20:39:44.516ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94052025-01-06T20:39:44.519ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ccee3cb9-85e2-4135-9e23-45c41afea236, lookup_type: ById(ccee3cb9-85e2-4135-9e23-45c41afea236) }, key: fd5c27b2-8ae1-4307-8322-c553e5d585f6, lookup_type: ById(fd5c27b2-8ae1-4307-8322-c553e5d585f6) }, key: 3bde1b6c-87a2-46cb-a844-f287d6d62a70, lookup_type: ById(3bde1b6c-87a2-46cb-a844-f287d6d62a70) } result = Ok(()) saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94062025-01-06T20:39:44.519ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94072025-01-06T20:39:44.519ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
94082025-01-06T20:39:44.527ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 87531b6c-ba3d-4f5c-a16b-8ae0e8efa200, time_created: 2025-01-06T20:39:23.805856Z, time_deleted: None, instance_id: 3bde1b6c-87a2-46cb-a844-f287d6d62a70, sled_id: 346c1d3f-8af0-46bf-8798-77d7bb811a90, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-01-06T20:39:44.346610Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-01-06T20:39:21.481611Z, gen: Generation(Generation(3)), propolis_id: Some(87531b6c-ba3d-4f5c-a16b-8ae0e8efa200), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-01-06T20:39:44.527100297Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
94092025-01-06T20:39:44.531ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update
94102025-01-06T20:39:44.531ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"3bde1b6c-87a2-46cb-a844-f287d6d62a70","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"87531b6c-ba3d-4f5c-a16b-8ae0e8efa200"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"3bde1b6c-87a2-46cb-a844-f287d6d62a70","lookup_type":{"ById":"3bde1b6c-87a2-46cb-a844-f287d6d62a70"},"parent":{"key":"fd5c27b2-8ae1-4307-8322-c553e5d585f6","lookup_type":{"ById":"fd5c27b2-8ae1-4307-8322-c553e5d585f6"},"parent":{"key":"ccee3cb9-85e2-4135-9e23-45c41afea236","lookup_type":{"ById":"ccee3cb9-85e2-4135-9e23-45c41afea236"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"19099102-c5b5-4f21-b9b0-642d1481b209"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"fd5c27b2-8ae1-4307-8322-c553e5d585f6","ram_diff":1073741824},"destroy_active_vmm":"87531b6c-ba3d-4f5c-a16b-8ae0e8efa200","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-01-06T20:39:44.527100297Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94112025-01-06T20:39:44.531ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update
94122025-01-06T20:39:44.539ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update
94132025-01-06T20:39:44.539ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94142025-01-06T20:39:44.539ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94152025-01-06T20:39:44.539ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
94162025-01-06T20:39:44.542ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94172025-01-06T20:39:44.542ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
94182025-01-06T20:39:44.546ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94192025-01-06T20:39:44.546ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
94202025-01-06T20:39:44.549ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94212025-01-06T20:39:44.549ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("686b4bb6-9fa3-46aa-b49b-dea144ae5d7e")) node_id = 0 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
94222025-01-06T20:39:44.552ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94232025-01-06T20:39:44.552ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
94242025-01-06T20:39:44.559ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 parent_lock = UpdaterLock { updater_id: 19099102-c5b5-4f21-b9b0-642d1481b209, locked_gen: Generation(Generation(2)) } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update
94252025-01-06T20:39:44.559ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = BecomeUpdater
94262025-01-06T20:39:44.560ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = BecomeUpdater
94272025-01-06T20:39:44.567ZDEBGnexus (SagaExecutor): inherited lock from 19099102-c5b5-4f21-b9b0-642d1481b209 to 686b4bb6-9fa3-46aa-b49b-dea144ae5d7e actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 19099102-c5b5-4f21-b9b0-642d1481b209 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = BecomeUpdater updater_id = 686b4bb6-9fa3-46aa-b49b-dea144ae5d7e
94282025-01-06T20:39:44.567ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update
94292025-01-06T20:39:44.567ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94302025-01-06T20:39:44.567ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("686b4bb6-9fa3-46aa-b49b-dea144ae5d7e")}) node_id = 1 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
94312025-01-06T20:39:44.571ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94322025-01-06T20:39:44.571ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
94332025-01-06T20:39:44.574ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94342025-01-06T20:39:44.574ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
94352025-01-06T20:39:44.577ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94362025-01-06T20:39:44.577ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
94372025-01-06T20:39:44.581ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update
94382025-01-06T20:39:44.581ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70
94392025-01-06T20:39:44.581ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = UpdateNetworkConfig
94402025-01-06T20:39:44.581ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = UpdateNetworkConfig
94412025-01-06T20:39:44.586ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = UpdateNetworkConfig
94422025-01-06T20:39:44.586ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = UpdateNetworkConfig
94432025-01-06T20:39:44.591ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
94442025-01-06T20:39:44.591ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = UpdateNetworkConfig
94452025-01-06T20:39:44.591ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = UpdateNetworkConfig
94462025-01-06T20:39:44.593ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
94472025-01-06T20:39:44.593ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
94482025-01-06T20:39:44.593ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
94492025-01-06T20:39:44.595ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
94502025-01-06T20:39:44.596ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
94512025-01-06T20:39:44.596ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
94522025-01-06T20:39:44.596ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
94532025-01-06T20:39:44.601ZDEBGnexus: notifying dendrite of updates instance_id = Some(3bde1b6c-87a2-46cb-a844-f287d6d62a70 (instance)) switch = switch0
94542025-01-06T20:39:44.601ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1427, tv_nsec: 293081721 } })
94552025-01-06T20:39:44.602ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
94562025-01-06T20:39:44.632ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
94572025-01-06T20:39:44.632ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94582025-01-06T20:39:44.632ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd30da27-f2d8-4427-961c-2ac8ac959f4b", "content-length": "26", "date": "Mon, 06 Jan 2025 20:39:44 GMT"} })
94592025-01-06T20:39:44.632ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94602025-01-06T20:39:44.633ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94612025-01-06T20:39:44.662ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
94622025-01-06T20:39:44.663ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f9cb350-330f-40ee-b3cc-bff9101d4e4c", "content-length": "4", "date": "Mon, 06 Jan 2025 20:39:44 GMT"} })
94632025-01-06T20:39:44.664ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94642025-01-06T20:39:44.664ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
94652025-01-06T20:39:44.667ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94662025-01-06T20:39:44.667ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
94672025-01-06T20:39:44.673ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
94682025-01-06T20:39:44.673ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
94692025-01-06T20:39:44.691ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-01-06T20:39:44.681003Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: ccee3cb9-85e2-4135-9e23-45c41afea236, time_modified: Some(2025-01-06T20:39:44.681003Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: fd5c27b2-8ae1-4307-8322-c553e5d585f6, time_modified: Some(2025-01-06T20:39:44.681003Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update
94702025-01-06T20:39:44.691ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94712025-01-06T20:39:44.691ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
94722025-01-06T20:39:44.694ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94732025-01-06T20:39:44.694ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
94742025-01-06T20:39:44.698ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update
94752025-01-06T20:39:44.698ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = UnassignOximeterProducer
94762025-01-06T20:39:44.698ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = UnassignOximeterProducer
94772025-01-06T20:39:44.705ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 3aa155a2-91f9-44a1-9f26-4a40e0aef546 producer_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update
94782025-01-06T20:39:44.705ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = UnassignOximeterProducer
94792025-01-06T20:39:44.705ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = UnassignOximeterProducer
94802025-01-06T20:39:44.743ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update
94812025-01-06T20:39:44.745ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/3bde1b6c-87a2-46cb-a844-f287d6d62a70
94822025-01-06T20:39:44.760ZDEBGnexus (SagaExecutor): client response oximeter-collector = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/3bde1b6c-87a2-46cb-a844-f287d6d62a70", status: 204, headers: {"x-request-id": "79c586e4-855c-472c-8197-21a527412d66", "date": "Mon, 06 Jan 2025 20:39:44 GMT"} }) saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update
94832025-01-06T20:39:44.760ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 3aa155a2-91f9-44a1-9f26-4a40e0aef546 producer_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update
94842025-01-06T20:39:44.761ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94852025-01-06T20:39:44.761ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
94862025-01-06T20:39:44.765ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94872025-01-06T20:39:44.765ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
94882025-01-06T20:39:44.769ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 lock = UpdaterLock { updater_id: 686b4bb6-9fa3-46aa-b49b-dea144ae5d7e, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-01-06T20:39:44.527100297Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update
94892025-01-06T20:39:44.769ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = CommitInstanceUpdates
94902025-01-06T20:39:44.769ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = CommitInstanceUpdates
94912025-01-06T20:39:44.778ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 new_runtime = InstanceRuntimeState { time_updated: 2025-01-06T20:39:44.527100297Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update
94922025-01-06T20:39:44.778ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
94932025-01-06T20:39:44.778ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
94942025-01-06T20:39:44.778ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Signaled
94952025-01-06T20:39:44.778ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Signaled
94962025-01-06T20:39:44.778ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
94972025-01-06T20:39:44.778ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94982025-01-06T20:39:44.778ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94992025-01-06T20:39:44.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95002025-01-06T20:39:44.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95012025-01-06T20:39:44.779ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95022025-01-06T20:39:44.781ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
95032025-01-06T20:39:44.781ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95042025-01-06T20:39:44.781ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
95052025-01-06T20:39:44.781ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
95062025-01-06T20:39:44.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95072025-01-06T20:39:44.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95082025-01-06T20:39:44.784ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
95092025-01-06T20:39:44.784ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
95102025-01-06T20:39:44.784ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("3bde1b6c-87a2-46cb-a844-f287d6d62a70"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("87531b6c-ba3d-4f5c-a16b-8ae0e8efa200")}) node_id = 7 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
95112025-01-06T20:39:44.784ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95122025-01-06T20:39:44.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95132025-01-06T20:39:44.787ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
95142025-01-06T20:39:44.787ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
95152025-01-06T20:39:44.790ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
95162025-01-06T20:39:44.790ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
95172025-01-06T20:39:44.794ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
95182025-01-06T20:39:44.794ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
95192025-01-06T20:39:44.798ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 propolis_id = 87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update
95202025-01-06T20:39:44.798ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = ReleaseSledResources
95212025-01-06T20:39:44.799ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = ReleaseSledResources
95222025-01-06T20:39:44.818ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
95232025-01-06T20:39:44.818ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95242025-01-06T20:39:44.818ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe44b1ff-58be-4c58-b5fa-b3802026b9c5", "content-length": "372", "date": "Mon, 06 Jan 2025 20:39:44 GMT"} })
95252025-01-06T20:39:44.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95262025-01-06T20:39:44.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95272025-01-06T20:39:44.832ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {e1fb51c3-cec2-4cd7-b330-82d8dfdcd738: {10.151.2.175: {202361a5-afb9-4390-be68-15e4e34508e0}, 10.151.2.176: {202361a5-afb9-4390-be68-15e4e34508e0}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
95282025-01-06T20:39:44.832ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
95292025-01-06T20:39:44.832ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d7faf50e-4f18-4008-a987-363620cfc9d0", "date": "Mon, 06 Jan 2025 20:39:44 GMT"} })
95302025-01-06T20:39:44.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95312025-01-06T20:39:44.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95322025-01-06T20:39:44.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95332025-01-06T20:39:44.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95342025-01-06T20:39:44.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95352025-01-06T20:39:44.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95362025-01-06T20:39:44.840ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95372025-01-06T20:39:44.840ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95382025-01-06T20:39:44.840ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "15aa2e19-1c87-4a87-8eb1-bd9578d196a7", "date": "Mon, 06 Jan 2025 20:39:44 GMT"} })
95392025-01-06T20:39:44.842ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 64.337742ms iteration = 24 status = {}
95402025-01-06T20:39:44.857ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
95412025-01-06T20:39:44.857ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
95422025-01-06T20:39:44.860ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
95432025-01-06T20:39:44.860ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
95442025-01-06T20:39:44.864ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 propolis_id = 87531b6c-ba3d-4f5c-a16b-8ae0e8efa200 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update
95452025-01-06T20:39:44.864ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = MarkVmmDeleted
95462025-01-06T20:39:44.864ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = MarkVmmDeleted
95472025-01-06T20:39:44.900ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
95482025-01-06T20:39:44.900ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
95492025-01-06T20:39:44.904ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
95502025-01-06T20:39:44.904ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
95512025-01-06T20:39:44.907ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
95522025-01-06T20:39:44.907ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
95532025-01-06T20:39:44.910ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
95542025-01-06T20:39:44.910ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
95552025-01-06T20:39:44.914ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = ChainSuccessorSaga
95562025-01-06T20:39:44.914ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = ChainSuccessorSaga
95572025-01-06T20:39:44.926ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95582025-01-06T20:39:44.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95592025-01-06T20:39:44.945ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = ChainSuccessorSaga
95602025-01-06T20:39:44.946ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = ChainSuccessorSaga
95612025-01-06T20:39:44.947ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = ChainSuccessorSaga
95622025-01-06T20:39:44.947ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = ChainSuccessorSaga
95632025-01-06T20:39:44.949ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = ChainSuccessorSaga
95642025-01-06T20:39:44.952ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ccee3cb9-85e2-4135-9e23-45c41afea236, lookup_type: ById(ccee3cb9-85e2-4135-9e23-45c41afea236) }, key: fd5c27b2-8ae1-4307-8322-c553e5d585f6, lookup_type: ById(fd5c27b2-8ae1-4307-8322-c553e5d585f6) }, key: 3bde1b6c-87a2-46cb-a844-f287d6d62a70, lookup_type: ById(3bde1b6c-87a2-46cb-a844-f287d6d62a70) } result = Ok(()) saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = ChainSuccessorSaga
95652025-01-06T20:39:44.952ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = ChainSuccessorSaga
95662025-01-06T20:39:44.953ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_node = ChainSuccessorSaga
95672025-01-06T20:39:44.958ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update
95682025-01-06T20:39:44.958ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
95692025-01-06T20:39:44.958ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
95702025-01-06T20:39:44.958ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Signaled
95712025-01-06T20:39:44.958ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
95722025-01-06T20:39:44.958ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95732025-01-06T20:39:44.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
95742025-01-06T20:39:44.961ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
95752025-01-06T20:39:44.961ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
95762025-01-06T20:39:44.961ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95772025-01-06T20:39:44.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
95782025-01-06T20:39:44.961ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
95792025-01-06T20:39:44.961ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
95802025-01-06T20:39:44.965ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
95812025-01-06T20:39:44.965ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
95822025-01-06T20:39:44.968ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
95832025-01-06T20:39:44.968ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95
95842025-01-06T20:39:44.985ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
95852025-01-06T20:39:44.985ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95862025-01-06T20:39:44.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95872025-01-06T20:39:44.986ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
95882025-01-06T20:39:44.986ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95892025-01-06T20:39:44.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95902025-01-06T20:39:44.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95912025-01-06T20:39:44.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95922025-01-06T20:39:44.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95932025-01-06T20:39:44.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95942025-01-06T20:39:44.991ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
95952025-01-06T20:39:44.992ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
95962025-01-06T20:39:44.992ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95972025-01-06T20:39:44.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
95982025-01-06T20:39:44.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95992025-01-06T20:39:44.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96002025-01-06T20:39:44.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96012025-01-06T20:39:44.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
96022025-01-06T20:39:44.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96032025-01-06T20:39:44.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96042025-01-06T20:39:45.020ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
96052025-01-06T20:39:45.020ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 saga_name = instance-update saga_result = SagaResult { saga_id: afa1268a-6f93-4dd6-acfd-f06f09024d95, saga_log: SagaLog { saga_id: afa1268a-6f93-4dd6-acfd-f06f09024d95, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("686b4bb6-9fa3-46aa-b49b-dea144ae5d7e")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("686b4bb6-9fa3-46aa-b49b-dea144ae5d7e")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("3bde1b6c-87a2-46cb-a844-f287d6d62a70"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("87531b6c-ba3d-4f5c-a16b-8ae0e8efa200")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("3bde1b6c-87a2-46cb-a844-f287d6d62a70"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("87531b6c-ba3d-4f5c-a16b-8ae0e8efa200")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("686b4bb6-9fa3-46aa-b49b-dea144ae5d7e"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("686b4bb6-9fa3-46aa-b49b-dea144ae5d7e")}} }) }
96062025-01-06T20:39:45.020ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = afa1268a-6f93-4dd6-acfd-f06f09024d95 instance_id = 3bde1b6c-87a2-46cb-a844-f287d6d62a70 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update
96072025-01-06T20:39:45.020ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
96082025-01-06T20:39:45.020ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1
96092025-01-06T20:39:45.022ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
96102025-01-06T20:39:45.022ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.615026ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
96112025-01-06T20:39:45.025ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
96122025-01-06T20:39:45.025ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1
96132025-01-06T20:39:45.028ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
96142025-01-06T20:39:45.028ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1
96152025-01-06T20:39:45.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96162025-01-06T20:39:45.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96172025-01-06T20:39:45.033ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96182025-01-06T20:39:45.033ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
96192025-01-06T20:39:45.033ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
96202025-01-06T20:39:45.033ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 75.264179ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
96212025-01-06T20:39:45.033ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1
96222025-01-06T20:39:45.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 47.922964ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96232025-01-06T20:39:45.036ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96242025-01-06T20:39:45.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96252025-01-06T20:39:45.038ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96262025-01-06T20:39:45.040ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
96272025-01-06T20:39:45.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96282025-01-06T20:39:45.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96292025-01-06T20:39:45.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96302025-01-06T20:39:45.043ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
96312025-01-06T20:39:45.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96322025-01-06T20:39:45.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96332025-01-06T20:39:45.066ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update sec_id = d4581482-c7a8-479c-a435-cf6d95b38f96
96342025-01-06T20:39:45.066ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 5d26e96f-9275-43ea-8382-d18283b8dea1 saga_name = start-instance-update saga_result = SagaResult { saga_id: 5d26e96f-9275-43ea-8382-d18283b8dea1, saga_log: SagaLog { saga_id: 5d26e96f-9275-43ea-8382-d18283b8dea1, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("19099102-c5b5-4f21-b9b0-642d1481b209")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("19099102-c5b5-4f21-b9b0-642d1481b209")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("19099102-c5b5-4f21-b9b0-642d1481b209"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("19099102-c5b5-4f21-b9b0-642d1481b209")}} }) }
96352025-01-06T20:39:45.077ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
96362025-01-06T20:39:45.077ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef185f55-250c-4a8a-a132-fc6581d4f1a3", "content-length": "691", "date": "Mon, 06 Jan 2025 20:39:44 GMT"} })
96372025-01-06T20:39:45.077ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
96382025-01-06T20:39:45.077ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
96392025-01-06T20:39:45.077ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
96402025-01-06T20:39:45.078ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 300.431068ms iteration = 24 status = {}
96412025-01-06T20:39:45.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 16566cf3-56a8-4715-9213-a74d81ff7c2c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96422025-01-06T20:39:45.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 16566cf3-56a8-4715-9213-a74d81ff7c2c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96432025-01-06T20:39:45.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 16566cf3-56a8-4715-9213-a74d81ff7c2c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96442025-01-06T20:39:46.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6e34e3d8-0bbe-4798-9a4a-6604ea103108 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96452025-01-06T20:39:46.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6e34e3d8-0bbe-4798-9a4a-6604ea103108 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96462025-01-06T20:39:46.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6e34e3d8-0bbe-4798-9a4a-6604ea103108 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96472025-01-06T20:39:47.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8b96d87d-f7ab-4d6c-9b3f-f3b7ef23b091 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96482025-01-06T20:39:47.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8b96d87d-f7ab-4d6c-9b3f-f3b7ef23b091 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96492025-01-06T20:39:47.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8b96d87d-f7ab-4d6c-9b3f-f3b7ef23b091 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96502025-01-06T20:39:47.759ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 581 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 12004b10-a8d9-40fb-a7cf-c554cb8fdd85 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
96512025-01-06T20:39:48.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ec966619-a7c8-46e3-974d-fde590164b6f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96522025-01-06T20:39:48.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ec966619-a7c8-46e3-974d-fde590164b6f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96532025-01-06T20:39:48.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ec966619-a7c8-46e3-974d-fde590164b6f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96542025-01-06T20:39:49.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d5026d6d-1e3d-4ae3-b211-35d21689d93d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96552025-01-06T20:39:49.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d5026d6d-1e3d-4ae3-b211-35d21689d93d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96562025-01-06T20:39:49.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = d5026d6d-1e3d-4ae3-b211-35d21689d93d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96572025-01-06T20:39:50.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fef2127e-668d-4828-83f5-57dc9e281df2 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96582025-01-06T20:39:50.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fef2127e-668d-4828-83f5-57dc9e281df2 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96592025-01-06T20:39:50.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fef2127e-668d-4828-83f5-57dc9e281df2 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96602025-01-06T20:39:51.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = adcf50c6-a925-4a8c-b2c2-09e77eb57b81 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96612025-01-06T20:39:51.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = adcf50c6-a925-4a8c-b2c2-09e77eb57b81 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96622025-01-06T20:39:51.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = adcf50c6-a925-4a8c-b2c2-09e77eb57b81 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96632025-01-06T20:39:52.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 65ce26a3-3a9b-42f0-ad8b-27b376de7233 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96642025-01-06T20:39:52.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 65ce26a3-3a9b-42f0-ad8b-27b376de7233 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96652025-01-06T20:39:52.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 65ce26a3-3a9b-42f0-ad8b-27b376de7233 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96662025-01-06T20:39:53.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a3fb27a4-7c19-46b3-a060-e039ad5b267b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96672025-01-06T20:39:53.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a3fb27a4-7c19-46b3-a060-e039ad5b267b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96682025-01-06T20:39:53.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2451 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a3fb27a4-7c19-46b3-a060-e039ad5b267b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96692025-01-06T20:39:54.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 65004c8e-3c6a-48a0-8d0c-14c034ba44bb roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96702025-01-06T20:39:54.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 65004c8e-3c6a-48a0-8d0c-14c034ba44bb resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96712025-01-06T20:39:54.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 65004c8e-3c6a-48a0-8d0c-14c034ba44bb response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96722025-01-06T20:39:54.986ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
96732025-01-06T20:39:54.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96742025-01-06T20:39:54.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96752025-01-06T20:39:54.986ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
96762025-01-06T20:39:54.986ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96772025-01-06T20:39:54.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96782025-01-06T20:39:54.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96792025-01-06T20:39:54.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96802025-01-06T20:39:54.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96812025-01-06T20:39:54.990ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.078031ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96822025-01-06T20:39:54.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96832025-01-06T20:39:54.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96842025-01-06T20:39:54.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96852025-01-06T20:39:54.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96862025-01-06T20:39:54.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96872025-01-06T20:39:54.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96882025-01-06T20:39:54.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
96892025-01-06T20:39:54.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96902025-01-06T20:39:54.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96912025-01-06T20:39:55.013ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
96922025-01-06T20:39:55.013ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.067336ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
96932025-01-06T20:39:55.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1d0e96a4-c618-4d16-9f54-91ce83953771 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96942025-01-06T20:39:55.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1d0e96a4-c618-4d16-9f54-91ce83953771 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96952025-01-06T20:39:55.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1d0e96a4-c618-4d16-9f54-91ce83953771 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96962025-01-06T20:39:56.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ec2f6e12-b6e3-4288-9beb-32bf0422d28f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96972025-01-06T20:39:56.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ec2f6e12-b6e3-4288-9beb-32bf0422d28f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96982025-01-06T20:39:56.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ec2f6e12-b6e3-4288-9beb-32bf0422d28f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
96992025-01-06T20:39:57.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 90159465-db59-4b71-ab5c-e4918041919b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97002025-01-06T20:39:57.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 90159465-db59-4b71-ab5c-e4918041919b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97012025-01-06T20:39:57.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 90159465-db59-4b71-ab5c-e4918041919b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97022025-01-06T20:39:57.759ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 888 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = d0ac1448-158a-4417-b8d2-e49cd026fe94 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
97032025-01-06T20:39:58.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2f4a999c-2089-4eca-8607-1be210dd2cad roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97042025-01-06T20:39:58.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2f4a999c-2089-4eca-8607-1be210dd2cad resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97052025-01-06T20:39:58.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2f4a999c-2089-4eca-8607-1be210dd2cad response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97062025-01-06T20:39:59.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c4160928-5729-47f6-b0e7-e8e08def0699 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97072025-01-06T20:39:59.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c4160928-5729-47f6-b0e7-e8e08def0699 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97082025-01-06T20:39:59.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2662 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c4160928-5729-47f6-b0e7-e8e08def0699 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97092025-01-06T20:40:00.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5303682e-5811-404e-a102-ce6fe6dea455 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97102025-01-06T20:40:00.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5303682e-5811-404e-a102-ce6fe6dea455 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97112025-01-06T20:40:00.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 5303682e-5811-404e-a102-ce6fe6dea455 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97122025-01-06T20:40:01.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8d5a221c-2da0-4c2b-8227-0456007960d4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97132025-01-06T20:40:01.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8d5a221c-2da0-4c2b-8227-0456007960d4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97142025-01-06T20:40:01.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8d5a221c-2da0-4c2b-8227-0456007960d4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97152025-01-06T20:40:02.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e524e2b5-8876-4c74-83b7-06c485588286 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97162025-01-06T20:40:02.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e524e2b5-8876-4c74-83b7-06c485588286 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97172025-01-06T20:40:02.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e524e2b5-8876-4c74-83b7-06c485588286 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97182025-01-06T20:40:03.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 764feb13-fee4-4519-9933-63b2224138a3 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97192025-01-06T20:40:03.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 764feb13-fee4-4519-9933-63b2224138a3 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97202025-01-06T20:40:03.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 764feb13-fee4-4519-9933-63b2224138a3 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97212025-01-06T20:40:04.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 89a65836-e72d-40b5-abce-62fb3a3daae2 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97222025-01-06T20:40:04.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 89a65836-e72d-40b5-abce-62fb3a3daae2 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97232025-01-06T20:40:04.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 89a65836-e72d-40b5-abce-62fb3a3daae2 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
97242025-01-06T20:40:04.985ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
97252025-01-06T20:40:04.985ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
97262025-01-06T20:40:04.985ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
97272025-01-06T20:40:04.985ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
97282025-01-06T20:40:04.985ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
97292025-01-06T20:40:04.985ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
97302025-01-06T20:40:04.985ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97312025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
97322025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97332025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
97342025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
97352025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
97362025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97372025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97382025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
97392025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
97402025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
97412025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97422025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
97432025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97442025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
97452025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
97462025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
97472025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
97482025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97492025-01-06T20:40:04.986ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
97502025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
97512025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
97522025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97532025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
97542025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97552025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97562025-01-06T20:40:04.986ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
97572025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97582025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
97592025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
97602025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97612025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97622025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97632025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97642025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
97652025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97662025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97672025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
97682025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97692025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97702025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97712025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97722025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97732025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97742025-01-06T20:40:04.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97752025-01-06T20:40:04.988ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1447, tv_nsec: 679985544 } })
97762025-01-06T20:40:04.988ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
97772025-01-06T20:40:04.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97782025-01-06T20:40:04.989ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1447, tv_nsec: 681097764 } })
97792025-01-06T20:40:04.989ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
97802025-01-06T20:40:04.990ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.541584ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97812025-01-06T20:40:04.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97822025-01-06T20:40:04.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97832025-01-06T20:40:04.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97842025-01-06T20:40:04.994ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97852025-01-06T20:40:04.994ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97862025-01-06T20:40:04.995ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97872025-01-06T20:40:04.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97882025-01-06T20:40:04.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
97892025-01-06T20:40:04.996ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97902025-01-06T20:40:04.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97912025-01-06T20:40:04.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97922025-01-06T20:40:04.997ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97932025-01-06T20:40:04.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97942025-01-06T20:40:04.998ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97952025-01-06T20:40:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97962025-01-06T20:40:05.000ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97972025-01-06T20:40:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97982025-01-06T20:40:05.005ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97992025-01-06T20:40:05.006ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 19.252254ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98002025-01-06T20:40:05.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98012025-01-06T20:40:05.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98022025-01-06T20:40:05.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98032025-01-06T20:40:05.010ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1447, tv_nsec: 701490739 } })
98042025-01-06T20:40:05.010ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
98052025-01-06T20:40:05.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98062025-01-06T20:40:05.012ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98072025-01-06T20:40:05.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98082025-01-06T20:40:05.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
98092025-01-06T20:40:05.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98102025-01-06T20:40:05.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98112025-01-06T20:40:05.039ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
98122025-01-06T20:40:05.039ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.858317ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
98132025-01-06T20:40:05.047ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.322302ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
98142025-01-06T20:40:05.047ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98152025-01-06T20:40:05.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98162025-01-06T20:40:05.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.664335ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
98172025-01-06T20:40:05.054ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
98182025-01-06T20:40:05.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
98192025-01-06T20:40:05.055ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 69.122382ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98202025-01-06T20:40:05.056ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
98212025-01-06T20:40:05.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98222025-01-06T20:40:05.058ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.258599ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98232025-01-06T20:40:05.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98242025-01-06T20:40:05.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98252025-01-06T20:40:05.059ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98262025-01-06T20:40:05.059ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
98272025-01-06T20:40:05.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98282025-01-06T20:40:05.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98292025-01-06T20:40:05.061ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98302025-01-06T20:40:05.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98312025-01-06T20:40:05.061ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98322025-01-06T20:40:05.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98332025-01-06T20:40:05.062ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98342025-01-06T20:40:05.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98352025-01-06T20:40:05.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98362025-01-06T20:40:05.064ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98372025-01-06T20:40:05.064ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98382025-01-06T20:40:05.064ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98392025-01-06T20:40:05.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98402025-01-06T20:40:05.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
98412025-01-06T20:40:05.064ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98422025-01-06T20:40:05.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98432025-01-06T20:40:05.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98442025-01-06T20:40:05.068ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98452025-01-06T20:40:05.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98462025-01-06T20:40:05.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98472025-01-06T20:40:05.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98482025-01-06T20:40:05.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98492025-01-06T20:40:05.070ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
98502025-01-06T20:40:05.070ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.051681ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
98512025-01-06T20:40:05.073ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98522025-01-06T20:40:05.073ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98532025-01-06T20:40:05.073ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5114d526-1fb1-470d-b2ac-8cc121117418", "content-length": "26", "date": "Mon, 06 Jan 2025 20:40:05 GMT"} })
98542025-01-06T20:40:05.073ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98552025-01-06T20:40:05.075ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98562025-01-06T20:40:05.079ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98572025-01-06T20:40:05.079ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98582025-01-06T20:40:05.080ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c497b64-1abc-4519-8d17-be79aedb85d3", "content-length": "26", "date": "Mon, 06 Jan 2025 20:40:05 GMT"} })
98592025-01-06T20:40:05.080ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98602025-01-06T20:40:05.082ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98612025-01-06T20:40:05.088ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98622025-01-06T20:40:05.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98632025-01-06T20:40:05.095ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98642025-01-06T20:40:05.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98652025-01-06T20:40:05.097ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98662025-01-06T20:40:05.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98672025-01-06T20:40:05.099ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
98682025-01-06T20:40:05.099ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98692025-01-06T20:40:05.100ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec332c37-4bf8-43cc-aa50-8c9ac00a4971", "content-length": "26", "date": "Mon, 06 Jan 2025 20:40:05 GMT"} })
98702025-01-06T20:40:05.100ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98712025-01-06T20:40:05.101ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 115.095963ms iteration = 27 status = {"physical_disks_added":0}
98722025-01-06T20:40:05.102ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
98732025-01-06T20:40:05.104ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98742025-01-06T20:40:05.104ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98752025-01-06T20:40:05.104ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 117.653723ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98762025-01-06T20:40:05.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 138.378687ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
98772025-01-06T20:40:05.133ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98782025-01-06T20:40:05.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98792025-01-06T20:40:05.180ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
98802025-01-06T20:40:05.180ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d3dfa42-8da9-4d11-b583-ea3086e0bf1b", "content-length": "2", "date": "Mon, 06 Jan 2025 20:40:04 GMT"} })
98812025-01-06T20:40:05.181ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98822025-01-06T20:40:05.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98832025-01-06T20:40:05.184ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
98842025-01-06T20:40:05.184ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98852025-01-06T20:40:05.184ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc5db938-be4a-4278-8ce4-78c8bcf47187", "content-length": "372", "date": "Mon, 06 Jan 2025 20:40:05 GMT"} })
98862025-01-06T20:40:05.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98872025-01-06T20:40:05.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98882025-01-06T20:40:05.185ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 199.739127ms iteration = 24 status = {}
98892025-01-06T20:40:05.186ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98902025-01-06T20:40:05.186ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98912025-01-06T20:40:05.188ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 202.329337ms iteration = 24 status = null
98922025-01-06T20:40:05.188ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98932025-01-06T20:40:05.188ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98942025-01-06T20:40:05.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98952025-01-06T20:40:05.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
98962025-01-06T20:40:05.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98972025-01-06T20:40:05.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98982025-01-06T20:40:05.191ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98992025-01-06T20:40:05.192ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 205.194786ms iteration = 24 status = 0
99002025-01-06T20:40:05.192ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99012025-01-06T20:40:05.192ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99022025-01-06T20:40:05.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99032025-01-06T20:40:05.208ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
99042025-01-06T20:40:05.208ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
99052025-01-06T20:40:05.208ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f935ed3b-8d9f-443f-976e-896cf23cb3b1", "date": "Mon, 06 Jan 2025 20:40:05 GMT"} })
99062025-01-06T20:40:05.208ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99072025-01-06T20:40:05.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99082025-01-06T20:40:05.211ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99092025-01-06T20:40:05.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99102025-01-06T20:40:05.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99112025-01-06T20:40:05.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99122025-01-06T20:40:05.221ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99132025-01-06T20:40:05.221ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99142025-01-06T20:40:05.222ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "854e8f81-eb55-4ef4-a853-52a9089bf83d", "date": "Mon, 06 Jan 2025 20:40:05 GMT"} })
99152025-01-06T20:40:05.227ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 240.60051ms iteration = 25 status = {}
99162025-01-06T20:40:05.263ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99172025-01-06T20:40:05.263ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4e13a73-9d96-4c87-85d2-2d598e6b5565", "content-length": "691", "date": "Mon, 06 Jan 2025 20:40:05 GMT"} })
99182025-01-06T20:40:05.263ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
99192025-01-06T20:40:05.263ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
99202025-01-06T20:40:05.263ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
99212025-01-06T20:40:05.265ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 278.223414ms iteration = 25 status = {}
99222025-01-06T20:40:05.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99232025-01-06T20:40:05.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99242025-01-06T20:40:05.328ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
99252025-01-06T20:40:05.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99262025-01-06T20:40:05.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99272025-01-06T20:40:05.338ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99282025-01-06T20:40:05.338ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c21394e-83ef-43d2-9cf9-06370e85c7ce", "content-length": "134", "date": "Mon, 06 Jan 2025 20:40:04 GMT"} })
99292025-01-06T20:40:05.338ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
99302025-01-06T20:40:05.338ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
99312025-01-06T20:40:05.338ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99322025-01-06T20:40:05.338ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99332025-01-06T20:40:05.338ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99342025-01-06T20:40:05.338ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99352025-01-06T20:40:05.338ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99362025-01-06T20:40:05.338ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99372025-01-06T20:40:05.338ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99382025-01-06T20:40:05.339ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99392025-01-06T20:40:05.339ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
99402025-01-06T20:40:05.339ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99412025-01-06T20:40:05.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99422025-01-06T20:40:05.341ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99432025-01-06T20:40:05.341ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "14687506-6d21-41db-82d5-11aa692f0d3a", "content-length": "2", "date": "Mon, 06 Jan 2025 20:40:04 GMT"} })
99442025-01-06T20:40:05.341ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99452025-01-06T20:40:05.341ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff488ccc-58b4-4ed7-8815-03cd1709c8ed", "content-length": "52", "date": "Mon, 06 Jan 2025 20:40:04 GMT"} })
99462025-01-06T20:40:05.342ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
99472025-01-06T20:40:05.342ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99482025-01-06T20:40:05.442ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "db2f6ed1-0a32-407a-a67a-2f16d4209494", "date": "Mon, 06 Jan 2025 20:40:05 GMT"} })
99492025-01-06T20:40:05.442ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
99502025-01-06T20:40:05.442ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99512025-01-06T20:40:05.443ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f94c4f98-7127-4201-b072-8a4d86740cfb", "content-length": "682", "date": "Mon, 06 Jan 2025 20:40:05 GMT"} })
99522025-01-06T20:40:05.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99532025-01-06T20:40:05.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99542025-01-06T20:40:05.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99552025-01-06T20:40:05.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99562025-01-06T20:40:05.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99572025-01-06T20:40:05.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99582025-01-06T20:40:05.454ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99592025-01-06T20:40:05.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99602025-01-06T20:40:05.461ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 474.492456ms iteration = 24 status = {}
99612025-01-06T20:40:05.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fe4874af-94fa-4d0a-80cb-f89029ad051e roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99622025-01-06T20:40:05.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fe4874af-94fa-4d0a-80cb-f89029ad051e resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99632025-01-06T20:40:05.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fe4874af-94fa-4d0a-80cb-f89029ad051e response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99642025-01-06T20:40:06.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 50e6da5b-04bb-4528-aba8-f1648859b33f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99652025-01-06T20:40:06.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 50e6da5b-04bb-4528-aba8-f1648859b33f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99662025-01-06T20:40:06.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1809 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 50e6da5b-04bb-4528-aba8-f1648859b33f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99672025-01-06T20:40:07.760ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 938 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 59208706-691f-481d-a4ff-eea0e6b2c2e9 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
99682025-01-06T20:40:07.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a1593c21-07c4-4c61-83b3-14d39f170b38 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99692025-01-06T20:40:07.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a1593c21-07c4-4c61-83b3-14d39f170b38 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99702025-01-06T20:40:07.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a1593c21-07c4-4c61-83b3-14d39f170b38 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99712025-01-06T20:40:08.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = aa115131-6605-4cc5-8376-6bf4926026fc roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99722025-01-06T20:40:08.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = aa115131-6605-4cc5-8376-6bf4926026fc resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99732025-01-06T20:40:08.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = aa115131-6605-4cc5-8376-6bf4926026fc response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99742025-01-06T20:40:09.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4409696d-db26-4e43-94d9-8d9000c27d72 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99752025-01-06T20:40:09.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4409696d-db26-4e43-94d9-8d9000c27d72 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99762025-01-06T20:40:09.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 4409696d-db26-4e43-94d9-8d9000c27d72 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99772025-01-06T20:40:10.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 506540a3-6494-4ef5-8c70-062956edf763 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99782025-01-06T20:40:10.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 506540a3-6494-4ef5-8c70-062956edf763 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99792025-01-06T20:40:10.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2802 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 506540a3-6494-4ef5-8c70-062956edf763 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99802025-01-06T20:40:11.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 037c77e6-6c5a-4a5e-ae93-cfdf648524c1 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99812025-01-06T20:40:11.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 037c77e6-6c5a-4a5e-ae93-cfdf648524c1 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99822025-01-06T20:40:11.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 037c77e6-6c5a-4a5e-ae93-cfdf648524c1 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99832025-01-06T20:40:12.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8b6f0227-428e-49cf-ada4-25c6b4bf6a6f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99842025-01-06T20:40:12.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8b6f0227-428e-49cf-ada4-25c6b4bf6a6f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99852025-01-06T20:40:12.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2705 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8b6f0227-428e-49cf-ada4-25c6b4bf6a6f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99862025-01-06T20:40:13.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9aba9892-d599-4ed9-b40d-2ba920745e45 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99872025-01-06T20:40:13.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9aba9892-d599-4ed9-b40d-2ba920745e45 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99882025-01-06T20:40:13.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2634 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9aba9892-d599-4ed9-b40d-2ba920745e45 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99892025-01-06T20:40:14.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7673414c-b2e7-4a02-a343-23c30afc6bd6 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99902025-01-06T20:40:14.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7673414c-b2e7-4a02-a343-23c30afc6bd6 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99912025-01-06T20:40:14.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7673414c-b2e7-4a02-a343-23c30afc6bd6 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
99922025-01-06T20:40:14.985ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
99932025-01-06T20:40:14.985ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99942025-01-06T20:40:14.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99952025-01-06T20:40:14.986ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
99962025-01-06T20:40:14.986ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99972025-01-06T20:40:14.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99982025-01-06T20:40:14.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99992025-01-06T20:40:14.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100002025-01-06T20:40:14.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100012025-01-06T20:40:14.989ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.646009ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100022025-01-06T20:40:14.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100032025-01-06T20:40:14.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100042025-01-06T20:40:14.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100052025-01-06T20:40:14.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100062025-01-06T20:40:14.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100072025-01-06T20:40:14.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100082025-01-06T20:40:14.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
100092025-01-06T20:40:14.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100102025-01-06T20:40:14.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100112025-01-06T20:40:15.005ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
100122025-01-06T20:40:15.006ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.393105ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
100132025-01-06T20:40:15.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bd495502-2cf8-4d58-b527-ecac5fca4130 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100142025-01-06T20:40:15.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bd495502-2cf8-4d58-b527-ecac5fca4130 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100152025-01-06T20:40:15.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = bd495502-2cf8-4d58-b527-ecac5fca4130 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100162025-01-06T20:40:16.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 942bdc09-7ca5-4eaa-8e16-d8dc763ec1a9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100172025-01-06T20:40:16.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 942bdc09-7ca5-4eaa-8e16-d8dc763ec1a9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100182025-01-06T20:40:16.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2611 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 942bdc09-7ca5-4eaa-8e16-d8dc763ec1a9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100192025-01-06T20:40:17.759ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 558 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 4e65fc09-d278-4293-97bb-a8383b73ca8b response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
100202025-01-06T20:40:17.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 66d0e4a2-290b-4b8d-8bb9-51b5d6ba05a9 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100212025-01-06T20:40:17.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 66d0e4a2-290b-4b8d-8bb9-51b5d6ba05a9 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100222025-01-06T20:40:17.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 66d0e4a2-290b-4b8d-8bb9-51b5d6ba05a9 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100232025-01-06T20:40:19.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 10d33b92-32b5-47e4-a9f5-010f0a9c36c6 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100242025-01-06T20:40:19.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 10d33b92-32b5-47e4-a9f5-010f0a9c36c6 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100252025-01-06T20:40:19.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2633 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 10d33b92-32b5-47e4-a9f5-010f0a9c36c6 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100262025-01-06T20:40:20.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 610ff972-ab0e-440f-8e6f-f3d4010ebacf roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100272025-01-06T20:40:20.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 610ff972-ab0e-440f-8e6f-f3d4010ebacf resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100282025-01-06T20:40:20.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 610ff972-ab0e-440f-8e6f-f3d4010ebacf response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100292025-01-06T20:40:21.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fbca1161-a787-40e0-b831-cec57771a68a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100302025-01-06T20:40:21.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fbca1161-a787-40e0-b831-cec57771a68a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100312025-01-06T20:40:21.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = fbca1161-a787-40e0-b831-cec57771a68a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100322025-01-06T20:40:22.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 51c88f30-21b9-4e46-8368-306f150b5197 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100332025-01-06T20:40:22.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 51c88f30-21b9-4e46-8368-306f150b5197 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100342025-01-06T20:40:22.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 51c88f30-21b9-4e46-8368-306f150b5197 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100352025-01-06T20:40:23.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dfd1e1dd-b9f6-41e1-ae16-d559dcb57ec4 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100362025-01-06T20:40:23.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dfd1e1dd-b9f6-41e1-ae16-d559dcb57ec4 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100372025-01-06T20:40:23.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2710 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = dfd1e1dd-b9f6-41e1-ae16-d559dcb57ec4 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100382025-01-06T20:40:24.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ca605c38-c8a5-4570-b66c-2a99d79f8c86 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100392025-01-06T20:40:24.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ca605c38-c8a5-4570-b66c-2a99d79f8c86 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100402025-01-06T20:40:24.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ca605c38-c8a5-4570-b66c-2a99d79f8c86 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100412025-01-06T20:40:24.985ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
100422025-01-06T20:40:24.985ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100432025-01-06T20:40:24.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100442025-01-06T20:40:24.986ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
100452025-01-06T20:40:24.986ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100462025-01-06T20:40:24.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100472025-01-06T20:40:24.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100482025-01-06T20:40:24.987ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100492025-01-06T20:40:24.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100502025-01-06T20:40:24.989ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.766633ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100512025-01-06T20:40:24.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100522025-01-06T20:40:24.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100532025-01-06T20:40:24.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100542025-01-06T20:40:24.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100552025-01-06T20:40:24.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100562025-01-06T20:40:24.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100572025-01-06T20:40:24.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
100582025-01-06T20:40:24.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100592025-01-06T20:40:24.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100602025-01-06T20:40:25.005ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
100612025-01-06T20:40:25.005ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.950363ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
100622025-01-06T20:40:25.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 39c4b5ca-55b0-4dae-901a-39e954739fe5 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100632025-01-06T20:40:25.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 39c4b5ca-55b0-4dae-901a-39e954739fe5 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100642025-01-06T20:40:25.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 39c4b5ca-55b0-4dae-901a-39e954739fe5 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100652025-01-06T20:40:26.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7d3cd3e9-1be2-479a-a532-74caf2fe2c6a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100662025-01-06T20:40:26.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7d3cd3e9-1be2-479a-a532-74caf2fe2c6a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100672025-01-06T20:40:26.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2628 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 7d3cd3e9-1be2-479a-a532-74caf2fe2c6a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100682025-01-06T20:40:27.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c6279ce4-fe58-46d3-ae43-be39dc876573 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100692025-01-06T20:40:27.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c6279ce4-fe58-46d3-ae43-be39dc876573 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100702025-01-06T20:40:27.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2667 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c6279ce4-fe58-46d3-ae43-be39dc876573 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100712025-01-06T20:40:27.760ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 954 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 851a9a37-1543-4a37-bf3a-8e294edd64cc response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
100722025-01-06T20:40:28.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 76525ae4-a804-4cec-87ac-2bbdf58653ea roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100732025-01-06T20:40:28.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 76525ae4-a804-4cec-87ac-2bbdf58653ea resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100742025-01-06T20:40:28.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 76525ae4-a804-4cec-87ac-2bbdf58653ea response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100752025-01-06T20:40:29.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0906584a-3b74-4f21-8b03-d2ed49393b2d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100762025-01-06T20:40:29.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0906584a-3b74-4f21-8b03-d2ed49393b2d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100772025-01-06T20:40:29.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0906584a-3b74-4f21-8b03-d2ed49393b2d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100782025-01-06T20:40:30.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0105c9f1-66a2-4087-ad38-900d2fcb0d2f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100792025-01-06T20:40:30.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0105c9f1-66a2-4087-ad38-900d2fcb0d2f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100802025-01-06T20:40:30.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 0105c9f1-66a2-4087-ad38-900d2fcb0d2f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100812025-01-06T20:40:31.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 60e4cdb7-db1f-4035-9852-326a6f3dd50a roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100822025-01-06T20:40:31.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 60e4cdb7-db1f-4035-9852-326a6f3dd50a resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100832025-01-06T20:40:31.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 60e4cdb7-db1f-4035-9852-326a6f3dd50a response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100842025-01-06T20:40:32.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 35bee698-8da7-4f07-a9d5-578044463013 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100852025-01-06T20:40:32.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 35bee698-8da7-4f07-a9d5-578044463013 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100862025-01-06T20:40:32.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 35bee698-8da7-4f07-a9d5-578044463013 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100872025-01-06T20:40:33.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 393e20e7-99ba-4a47-aa33-b45ab1150d30 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100882025-01-06T20:40:33.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 393e20e7-99ba-4a47-aa33-b45ab1150d30 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100892025-01-06T20:40:33.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 393e20e7-99ba-4a47-aa33-b45ab1150d30 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100902025-01-06T20:40:34.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 32cbe246-6f40-42fa-b322-abfde85dd562 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100912025-01-06T20:40:34.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 32cbe246-6f40-42fa-b322-abfde85dd562 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100922025-01-06T20:40:34.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2617 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 32cbe246-6f40-42fa-b322-abfde85dd562 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
100932025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
100942025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
100952025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
100962025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
100972025-01-06T20:40:34.985ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-06 20:30:34.985406564 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
100982025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
100992025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
101002025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
101012025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
101022025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101032025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
101042025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
101052025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
101062025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101072025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
101082025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
101092025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
101102025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
101112025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
101122025-01-06T20:40:34.985ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468
101132025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
101142025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.761\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468"}
101152025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
101162025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
101172025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101182025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
101192025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
101202025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
101212025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
101222025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
101232025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
101242025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
101252025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101262025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101272025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101282025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
101292025-01-06T20:40:34.985ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
101302025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101312025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
101322025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101332025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
101342025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
101352025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
101362025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
101372025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
101382025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
101392025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
101402025-01-06T20:40:34.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101412025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
101422025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101432025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
101442025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
101452025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101462025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101472025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
101482025-01-06T20:40:34.986ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
101492025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
101502025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101512025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
101522025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101532025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101542025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
101552025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101562025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
101572025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
101582025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101592025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101602025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
101612025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101622025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
101632025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
101642025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101652025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101662025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
101672025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
101682025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101692025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101702025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101712025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101722025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
101732025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101742025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101752025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
101762025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101772025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101782025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101792025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
101802025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
101812025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101822025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101832025-01-06T20:40:34.986ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("65bacdd1-9837-48ad-941c-aec5e2d79006.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("66b4065d-0a65-4141-b8ec-3ce1f64a2d26.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1477, tv_nsec: 678485643 } })
101842025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101852025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101862025-01-06T20:40:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101872025-01-06T20:40:34.986ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("88aaaee6-38b4-4a83-9c08-04f0ea18e003.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8dd67555-06fb-4cef-b914-9650f0eeb68a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da59543a-af38-4044-9c19-4596e0861811.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1477, tv_nsec: 678671138 } })
101882025-01-06T20:40:34.987ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101892025-01-06T20:40:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101902025-01-06T20:40:34.987ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101912025-01-06T20:40:34.987ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
101922025-01-06T20:40:34.987ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101932025-01-06T20:40:34.987ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.680035ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
101942025-01-06T20:40:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101952025-01-06T20:40:34.987ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
101962025-01-06T20:40:34.987ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.954903ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
101972025-01-06T20:40:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101982025-01-06T20:40:34.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101992025-01-06T20:40:34.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102002025-01-06T20:40:34.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102012025-01-06T20:40:34.989ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.161583ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
102022025-01-06T20:40:34.990ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-06 20:30:34.985406564 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
102032025-01-06T20:40:34.990ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.999746ms iteration = 13 status = {"expiration":"2025-01-06T20:30:34.985406564Z","pruned":[]}
102042025-01-06T20:40:34.990ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102052025-01-06T20:40:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102062025-01-06T20:40:34.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102072025-01-06T20:40:34.991ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1477, tv_nsec: 683490309 } })
102082025-01-06T20:40:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102092025-01-06T20:40:34.992ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
102102025-01-06T20:40:34.992ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
102112025-01-06T20:40:34.992ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102122025-01-06T20:40:34.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102132025-01-06T20:40:34.994ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102142025-01-06T20:40:34.995ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.458028ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
102152025-01-06T20:40:34.995ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1477, tv_nsec: 686902812 } })
102162025-01-06T20:40:34.995ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
102172025-01-06T20:40:34.996ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102182025-01-06T20:40:34.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102192025-01-06T20:40:34.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102202025-01-06T20:40:34.997ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102212025-01-06T20:40:34.997ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.159401ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
102222025-01-06T20:40:34.999ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102232025-01-06T20:40:34.999ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102242025-01-06T20:40:34.999ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
102252025-01-06T20:40:34.999ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102262025-01-06T20:40:35.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102272025-01-06T20:40:35.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
102282025-01-06T20:40:35.001ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102292025-01-06T20:40:35.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102302025-01-06T20:40:35.001ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
102312025-01-06T20:40:35.001ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
102322025-01-06T20:40:35.001ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 15.790559ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
102332025-01-06T20:40:35.002ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
102342025-01-06T20:40:35.002ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102352025-01-06T20:40:35.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102362025-01-06T20:40:35.003ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102372025-01-06T20:40:35.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102382025-01-06T20:40:35.005ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102392025-01-06T20:40:35.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102402025-01-06T20:40:35.007ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102412025-01-06T20:40:35.008ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.217775ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
102422025-01-06T20:40:35.008ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102432025-01-06T20:40:35.009ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102442025-01-06T20:40:35.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102452025-01-06T20:40:35.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
102462025-01-06T20:40:35.010ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
102472025-01-06T20:40:35.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
102482025-01-06T20:40:35.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
102492025-01-06T20:40:35.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102502025-01-06T20:40:35.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102512025-01-06T20:40:35.015ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102522025-01-06T20:40:35.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
102532025-01-06T20:40:35.017ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102542025-01-06T20:40:35.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102552025-01-06T20:40:35.019ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102562025-01-06T20:40:35.019ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102572025-01-06T20:40:35.020ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102582025-01-06T20:40:35.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102592025-01-06T20:40:35.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102602025-01-06T20:40:35.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102612025-01-06T20:40:35.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
102622025-01-06T20:40:35.021ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102632025-01-06T20:40:35.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102642025-01-06T20:40:35.021ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102652025-01-06T20:40:35.021ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102662025-01-06T20:40:35.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102672025-01-06T20:40:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
102682025-01-06T20:40:35.023ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102692025-01-06T20:40:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102702025-01-06T20:40:35.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102712025-01-06T20:40:35.027ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102722025-01-06T20:40:35.027ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
102732025-01-06T20:40:35.027ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102742025-01-06T20:40:35.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102752025-01-06T20:40:35.032ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102762025-01-06T20:40:35.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102772025-01-06T20:40:35.037ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
102782025-01-06T20:40:35.037ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 51.288736ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
102792025-01-06T20:40:35.037ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-346c1d3f-8af0-46bf-8798-77d7bb811a90.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1477, tv_nsec: 729590754 } })
102802025-01-06T20:40:35.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102812025-01-06T20:40:35.038ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
102822025-01-06T20:40:35.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
102832025-01-06T20:40:35.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102842025-01-06T20:40:35.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102852025-01-06T20:40:35.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102862025-01-06T20:40:35.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102872025-01-06T20:40:35.054ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102882025-01-06T20:40:35.054ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102892025-01-06T20:40:35.055ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102902025-01-06T20:40:35.056ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102912025-01-06T20:40:35.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102922025-01-06T20:40:35.057ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102932025-01-06T20:40:35.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102942025-01-06T20:40:35.057ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102952025-01-06T20:40:35.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102962025-01-06T20:40:35.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102972025-01-06T20:40:35.059ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102982025-01-06T20:40:35.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102992025-01-06T20:40:35.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103002025-01-06T20:40:35.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
103012025-01-06T20:40:35.059ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103022025-01-06T20:40:35.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103032025-01-06T20:40:35.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.364263ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
103042025-01-06T20:40:35.065ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103052025-01-06T20:40:35.065ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
103062025-01-06T20:40:35.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
103072025-01-06T20:40:35.067ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103082025-01-06T20:40:35.067ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103092025-01-06T20:40:35.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103102025-01-06T20:40:35.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103112025-01-06T20:40:35.068ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103122025-01-06T20:40:35.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103132025-01-06T20:40:35.070ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 84.330986ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
103142025-01-06T20:40:35.070ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103152025-01-06T20:40:35.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
103162025-01-06T20:40:35.071ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103172025-01-06T20:40:35.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103182025-01-06T20:40:35.072ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
103192025-01-06T20:40:35.072ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103202025-01-06T20:40:35.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103212025-01-06T20:40:35.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 87.783899ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103222025-01-06T20:40:35.074ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
103232025-01-06T20:40:35.074ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.843238ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
103242025-01-06T20:40:35.074ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103252025-01-06T20:40:35.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103262025-01-06T20:40:35.075ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103272025-01-06T20:40:35.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103282025-01-06T20:40:35.078ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103292025-01-06T20:40:35.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
103302025-01-06T20:40:35.080ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103312025-01-06T20:40:35.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103322025-01-06T20:40:35.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103332025-01-06T20:40:35.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
103342025-01-06T20:40:35.081ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103352025-01-06T20:40:35.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103362025-01-06T20:40:35.084ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
103372025-01-06T20:40:35.084ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
103382025-01-06T20:40:35.084ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
103392025-01-06T20:40:35.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103402025-01-06T20:40:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103412025-01-06T20:40:35.088ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
103422025-01-06T20:40:35.088ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
103432025-01-06T20:40:35.088ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 102.426418ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
103442025-01-06T20:40:35.096ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103452025-01-06T20:40:35.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103462025-01-06T20:40:35.113ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103472025-01-06T20:40:35.114ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
103482025-01-06T20:40:35.114ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 128.104277ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
103492025-01-06T20:40:35.114ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
103502025-01-06T20:40:35.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
103512025-01-06T20:40:35.128ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
103522025-01-06T20:40:35.128ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
103532025-01-06T20:40:35.128ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
103542025-01-06T20:40:35.129ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103552025-01-06T20:40:35.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103562025-01-06T20:40:35.133ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-06T20:28:32.843602Z, time_modified: 2025-01-06T20:28:32.843602Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ccee3cb9-85e2-4135-9e23-45c41afea236, db_silo: Silo { identity: SiloIdentity { id: ccee3cb9-85e2-4135-9e23-45c41afea236, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-06T20:28:37.133979Z, time_modified: 2025-01-06T20:28:37.133979Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a" }] }) }
103572025-01-06T20:40:35.133ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 147.560177ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]}},"default_endpoint":{"silo_id":"ccee3cb9-85e2-4135-9e23-45c41afea236","tls_certs":["7e70fcc1aacbc9256aa934a34ca6a2d08864815b06a7fc64bbc6e6bfa574fd2a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
103582025-01-06T20:40:35.152ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
103592025-01-06T20:40:35.152ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103602025-01-06T20:40:35.152ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "13f9b318-ef0b-4f91-a901-d143bf5f16c5", "content-length": "26", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} })
103612025-01-06T20:40:35.152ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103622025-01-06T20:40:35.154ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103632025-01-06T20:40:35.193ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 207.631832ms iteration = 28 status = {"physical_disks_added":0}
103642025-01-06T20:40:35.205ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
103652025-01-06T20:40:35.268ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 zone_address = fd00:1122:3344:101::2
103662025-01-06T20:40:35.268ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103672025-01-06T20:40:35.268ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "340db499-4176-47cd-85f9-28c46a6a0a8d", "content-length": "26", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} })
103682025-01-06T20:40:35.268ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103692025-01-06T20:40:35.271ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
103702025-01-06T20:40:35.301ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
103712025-01-06T20:40:35.301ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103722025-01-06T20:40:35.301ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b0be719-10ec-4b74-94d2-1bbc783d53f8", "content-length": "26", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} })
103732025-01-06T20:40:35.301ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103742025-01-06T20:40:35.303ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103752025-01-06T20:40:35.339ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
103762025-01-06T20:40:35.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1741b9d6-1bea-4556-aeea-963bdcbb45f3 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
103772025-01-06T20:40:35.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1741b9d6-1bea-4556-aeea-963bdcbb45f3 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
103782025-01-06T20:40:35.364ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
103792025-01-06T20:40:35.366ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d02905a6-f53b-43e4-a362-cefc45fcca65", "content-length": "691", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} })
103802025-01-06T20:40:35.366ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
103812025-01-06T20:40:35.366ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
103822025-01-06T20:40:35.366ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
103832025-01-06T20:40:35.371ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 385.38723ms iteration = 26 status = {}
103842025-01-06T20:40:35.372ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 386.342476ms iteration = 6 status = {"nsuccess":5}
103852025-01-06T20:40:35.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103862025-01-06T20:40:35.374ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103872025-01-06T20:40:35.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
103882025-01-06T20:40:35.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103892025-01-06T20:40:35.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103902025-01-06T20:40:35.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
103912025-01-06T20:40:35.380ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103922025-01-06T20:40:35.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103932025-01-06T20:40:35.388ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103942025-01-06T20:40:35.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103952025-01-06T20:40:35.415ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 429.315016ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
103962025-01-06T20:40:35.437ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
103972025-01-06T20:40:35.437ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 451.49508ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
103982025-01-06T20:40:35.473ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 488.169398ms iteration = 25 status = {}
103992025-01-06T20:40:35.474ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
104002025-01-06T20:40:35.474ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2ea09e3c-c079-4dc4-ba96-01c0ee5644ce", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
104012025-01-06T20:40:35.474ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
104022025-01-06T20:40:35.480ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d9156a00-0f08-433f-8a7e-0522cdb8523a", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
104032025-01-06T20:40:35.480ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
104042025-01-06T20:40:35.482ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
104052025-01-06T20:40:35.482ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 497.41717ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
104062025-01-06T20:40:35.495ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
104072025-01-06T20:40:35.496ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b65395f7-f452-4446-8449-1cba0770fe27", "content-length": "2", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} })
104082025-01-06T20:40:35.497ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104092025-01-06T20:40:35.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
104102025-01-06T20:40:35.515ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
104112025-01-06T20:40:35.515ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
104122025-01-06T20:40:35.516ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "79942153-1158-45bb-b700-fd9f474e1279", "content-length": "372", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} })
104132025-01-06T20:40:35.516ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104142025-01-06T20:40:35.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104152025-01-06T20:40:35.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161564 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1741b9d6-1bea-4556-aeea-963bdcbb45f3 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
104162025-01-06T20:40:35.520ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 535.27885ms iteration = 25 status = null
104172025-01-06T20:40:35.520ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104182025-01-06T20:40:35.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104192025-01-06T20:40:35.526ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
104202025-01-06T20:40:35.558ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
104212025-01-06T20:40:35.558ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
104222025-01-06T20:40:35.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104232025-01-06T20:40:35.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104242025-01-06T20:40:35.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104252025-01-06T20:40:35.560ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
104262025-01-06T20:40:35.560ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 0 version = 2
104272025-01-06T20:40:35.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104282025-01-06T20:40:35.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104292025-01-06T20:40:35.561ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104302025-01-06T20:40:35.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104312025-01-06T20:40:35.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
104322025-01-06T20:40:35.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104332025-01-06T20:40:35.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104342025-01-06T20:40:35.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 346c1d3f-8af0-46bf-8798-77d7bb811a90, lookup_type: ById(346c1d3f-8af0-46bf-8798-77d7bb811a90) } result = Ok(())
104352025-01-06T20:40:35.564ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104362025-01-06T20:40:35.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104372025-01-06T20:40:35.566ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
104382025-01-06T20:40:35.566ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
104392025-01-06T20:40:35.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
104402025-01-06T20:40:35.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104412025-01-06T20:40:35.566ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "95be031e-9c11-4d7c-b639-e1fd1ef7f38e", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} })
104422025-01-06T20:40:35.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104432025-01-06T20:40:35.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104442025-01-06T20:40:35.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104452025-01-06T20:40:35.568ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9d555ecd-b2f7-4e78-923b-54246f3588eb dns_zone_name = oxide.test found_so_far = 1 version = 2
104462025-01-06T20:40:35.568ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
104472025-01-06T20:40:35.568ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-06 20:28:37.181288 UTC dns_group = external generation = 2
104482025-01-06T20:40:35.568ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 583.223316ms iteration = 13 status = {"generation":2}
104492025-01-06T20:40:35.568ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 582.877337ms iteration = 25 status = 0
104502025-01-06T20:40:35.569ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 8c67328f-0310-40c5-bbfb-2dc6c3d1f9de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
104512025-01-06T20:40:35.569ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
104522025-01-06T20:40:35.569ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-06 20:28:35.848690 UTC dns_group = internal generation = 1
104532025-01-06T20:40:35.569ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 583.634766ms iteration = 13 status = {"generation":1}
104542025-01-06T20:40:35.570ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104552025-01-06T20:40:35.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104562025-01-06T20:40:35.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104572025-01-06T20:40:35.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104582025-01-06T20:40:35.577ZINFOnexus (BackgroundTasks): VPC route manager sled 346c1d3f-8af0-46bf-8798-77d7bb811a90 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
104592025-01-06T20:40:35.577ZDEBGnexus (BackgroundTasks): client request SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
104602025-01-06T20:40:35.578ZDEBGnexus (BackgroundTasks): client response SledAgent = 346c1d3f-8af0-46bf-8798-77d7bb811a90 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "69409400-7cfc-45aa-93e3-4e006e23309a", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} })
104612025-01-06T20:40:35.580ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 594.905163ms iteration = 26 status = {}
104622025-01-06T20:40:35.591ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
104632025-01-06T20:40:35.591ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "abcb3367-f1b6-4681-ac4f-b67fd6a16e65", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
104642025-01-06T20:40:35.591ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
104652025-01-06T20:40:35.594ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "71ad4200-c31c-4b9f-b2e8-8441222ba81f", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
104662025-01-06T20:40:35.594ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
104672025-01-06T20:40:35.596ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8bd7e9c8-f7af-44aa-ad76-a4162022586a", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
104682025-01-06T20:40:35.596ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
104692025-01-06T20:40:35.599ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
104702025-01-06T20:40:35.599ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 613.86569ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
104712025-01-06T20:40:35.622ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104722025-01-06T20:40:35.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104732025-01-06T20:40:35.625ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 62c71a50-bfda-408e-aa88-0e54296e2031, rack_id: 1353c275-9cc8-497c-a53d-ef09a740ab96, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c8fe97a-72f5-4fce-9b2d-aab0df546fc4) } rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
104742025-01-06T20:40:35.625ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104752025-01-06T20:40:35.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104762025-01-06T20:40:35.633ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
104772025-01-06T20:40:35.633ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d944e83b-d35d-489b-804d-6366f52e52d3", "content-length": "134", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} })
104782025-01-06T20:40:35.633ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
104792025-01-06T20:40:35.633ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c8fe97a-72f5-4fce-9b2d-aab0df546fc4
104802025-01-06T20:40:35.634ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
104812025-01-06T20:40:35.634ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
104822025-01-06T20:40:35.634ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104832025-01-06T20:40:35.634ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104842025-01-06T20:40:35.634ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104852025-01-06T20:40:35.634ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104862025-01-06T20:40:35.634ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104872025-01-06T20:40:35.634ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104882025-01-06T20:40:35.634ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96
104892025-01-06T20:40:35.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104902025-01-06T20:40:35.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104912025-01-06T20:40:35.636ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
104922025-01-06T20:40:35.636ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "76bb0701-b9aa-4782-8953-a0e41d488916", "content-length": "2", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} })
104932025-01-06T20:40:35.636ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
104942025-01-06T20:40:35.637ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d914a54-31da-488e-a240-94703139a67d", "content-length": "52", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} })
104952025-01-06T20:40:35.637ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch_location = Switch0
104962025-01-06T20:40:35.637ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
104972025-01-06T20:40:35.831ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1cc73480-1ef4-47ae-a5c5-c5e832800e9d", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} })
104982025-01-06T20:40:35.831ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 switch = Switch0
104992025-01-06T20:40:35.831ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
105002025-01-06T20:40:35.835ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1353c275-9cc8-497c-a53d-ef09a740ab96 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a899305-909e-4339-b43b-dc1e435260dc", "content-length": "682", "date": "Mon, 06 Jan 2025 20:40:35 GMT"} })
105012025-01-06T20:40:35.835ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105022025-01-06T20:40:35.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105032025-01-06T20:40:35.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105042025-01-06T20:40:35.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105052025-01-06T20:40:35.842ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105062025-01-06T20:40:35.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105072025-01-06T20:40:35.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105082025-01-06T20:40:35.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105092025-01-06T20:40:35.853ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 866.854107ms iteration = 25 status = {}
105102025-01-06T20:40:36.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6e2bac80-42df-4209-9095-a2b4c3643331 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105112025-01-06T20:40:36.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6e2bac80-42df-4209-9095-a2b4c3643331 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105122025-01-06T20:40:36.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6e2bac80-42df-4209-9095-a2b4c3643331 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105132025-01-06T20:40:37.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e7298127-8d39-4d03-b531-48e3392f952d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105142025-01-06T20:40:37.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e7298127-8d39-4d03-b531-48e3392f952d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105152025-01-06T20:40:37.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e7298127-8d39-4d03-b531-48e3392f952d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105162025-01-06T20:40:37.759ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 629 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = 78bb9443-52a2-4be9-8a87-7c41c6a32154 response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
105172025-01-06T20:40:38.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8fc41442-b403-4f12-977f-4438fa7b0189 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105182025-01-06T20:40:38.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8fc41442-b403-4f12-977f-4438fa7b0189 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105192025-01-06T20:40:38.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2618 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 8fc41442-b403-4f12-977f-4438fa7b0189 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105202025-01-06T20:40:39.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c21d34bc-4069-4db7-b92e-96fddbbbccec roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105212025-01-06T20:40:39.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c21d34bc-4069-4db7-b92e-96fddbbbccec resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105222025-01-06T20:40:39.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2533 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c21d34bc-4069-4db7-b92e-96fddbbbccec response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105232025-01-06T20:40:40.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6d7ed793-1644-4724-b3a8-be437f942b95 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105242025-01-06T20:40:40.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6d7ed793-1644-4724-b3a8-be437f942b95 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105252025-01-06T20:40:40.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2564 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6d7ed793-1644-4724-b3a8-be437f942b95 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105262025-01-06T20:40:41.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 29335f0b-f4ff-40e9-bd76-223ea1aa7c9c roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105272025-01-06T20:40:41.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 29335f0b-f4ff-40e9-bd76-223ea1aa7c9c resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105282025-01-06T20:40:41.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 29335f0b-f4ff-40e9-bd76-223ea1aa7c9c response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105292025-01-06T20:40:42.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ffdf1c92-2cab-4d5f-b26b-c626ea000cc5 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105302025-01-06T20:40:42.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ffdf1c92-2cab-4d5f-b26b-c626ea000cc5 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105312025-01-06T20:40:42.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = ffdf1c92-2cab-4d5f-b26b-c626ea000cc5 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105322025-01-06T20:40:43.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c9e34882-7eea-413c-ba92-a21a7de36d7f roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105332025-01-06T20:40:43.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c9e34882-7eea-413c-ba92-a21a7de36d7f resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105342025-01-06T20:40:43.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = c9e34882-7eea-413c-ba92-a21a7de36d7f response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105352025-01-06T20:40:44.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9a0c8044-624d-4cbe-b80f-803b6299178b roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105362025-01-06T20:40:44.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9a0c8044-624d-4cbe-b80f-803b6299178b resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105372025-01-06T20:40:44.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 9a0c8044-624d-4cbe-b80f-803b6299178b response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105382025-01-06T20:40:44.985ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
105392025-01-06T20:40:44.985ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105402025-01-06T20:40:44.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105412025-01-06T20:40:44.985ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
105422025-01-06T20:40:44.985ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105432025-01-06T20:40:44.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105442025-01-06T20:40:44.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105452025-01-06T20:40:44.989ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105462025-01-06T20:40:44.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105472025-01-06T20:40:44.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105482025-01-06T20:40:44.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105492025-01-06T20:40:44.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105502025-01-06T20:40:44.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105512025-01-06T20:40:44.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 020ef374-e3e4-4361-a906-8bf9ea4bd468, lookup_type: ById(020ef374-e3e4-4361-a906-8bf9ea4bd468) } result = Ok(())
105522025-01-06T20:40:44.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105532025-01-06T20:40:44.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105542025-01-06T20:40:45.009ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 original_time_created = 2025-01-06 20:28:26.740126 UTC target_id = 020ef374-e3e4-4361-a906-8bf9ea4bd468 time_created = 2025-01-06 20:28:26.740126 UTC
105552025-01-06T20:40:45.009ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.108146ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"020ef374-e3e4-4361-a906-8bf9ea4bd468","time_created":"2025-01-06T20:28:26.740126Z"}
105562025-01-06T20:40:45.015ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105572025-01-06T20:40:45.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105582025-01-06T20:40:45.043ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.69471ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105592025-01-06T20:40:45.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 11a596dd-a775-4caa-aa5f-a77ea4cf6201 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105602025-01-06T20:40:45.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 11a596dd-a775-4caa-aa5f-a77ea4cf6201 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105612025-01-06T20:40:45.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 11a596dd-a775-4caa-aa5f-a77ea4cf6201 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105622025-01-06T20:40:46.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2a65ee11-488c-4579-bde6-7cd1ebebe786 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105632025-01-06T20:40:46.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2a65ee11-488c-4579-bde6-7cd1ebebe786 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105642025-01-06T20:40:46.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2a65ee11-488c-4579-bde6-7cd1ebebe786 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105652025-01-06T20:40:47.750ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:64739
105662025-01-06T20:40:47.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64739 req_id = 174acf45-e849-4a14-9f8d-91bdbb180eaa roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
105672025-01-06T20:40:47.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64739 req_id = 174acf45-e849-4a14-9f8d-91bdbb180eaa resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
105682025-01-06T20:40:47.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64739 req_id = 174acf45-e849-4a14-9f8d-91bdbb180eaa response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?sort_by=id_ascending
105692025-01-06T20:40:47.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64739 req_id = f32077ff-6e0d-46f7-84f1-0df26e86278b roles = RoleSet { roles: {} } uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
105702025-01-06T20:40:47.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64739 req_id = f32077ff-6e0d-46f7-84f1-0df26e86278b resource = Database result = Ok(()) uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
105712025-01-06T20:40:47.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64739 req_id = f32077ff-6e0d-46f7-84f1-0df26e86278b response_code = 200 uri = /metrics/collectors/3aa155a2-91f9-44a1-9f26-4a40e0aef546/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMTgxMDk4NS1iYmJlLTQ4MWYtOTA1Zi05MTcyNWUyNTAyZTcifX0%3D
105722025-01-06T20:40:47.759ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 541 local_addr = [fd00:1122:3344:101::b]:60981 method = GET remote_addr = [fd00:1122:3344:101::d]:48766 req_id = dd6256a5-ad4d-4113-b42c-20b146b0a90c response_code = 200 uri = /d4581482-c7a8-479c-a435-cf6d95b38f96
105732025-01-06T20:40:47.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e27a41c9-76f1-4cac-841e-ccc2d827fddb roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105742025-01-06T20:40:47.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e27a41c9-76f1-4cac-841e-ccc2d827fddb resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105752025-01-06T20:40:47.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = e27a41c9-76f1-4cac-841e-ccc2d827fddb response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105762025-01-06T20:40:48.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a209acee-c890-4f73-8626-4ec1a659ca93 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105772025-01-06T20:40:48.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a209acee-c890-4f73-8626-4ec1a659ca93 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105782025-01-06T20:40:48.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = a209acee-c890-4f73-8626-4ec1a659ca93 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105792025-01-06T20:40:49.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2d67e0c5-9898-4982-80bf-80f19beb0b91 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105802025-01-06T20:40:49.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2d67e0c5-9898-4982-80bf-80f19beb0b91 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105812025-01-06T20:40:49.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 2d67e0c5-9898-4982-80bf-80f19beb0b91 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105822025-01-06T20:40:50.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6fcb5153-97ca-4fe8-846e-affc6ece7871 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105832025-01-06T20:40:50.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6fcb5153-97ca-4fe8-846e-affc6ece7871 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105842025-01-06T20:40:50.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2897 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 6fcb5153-97ca-4fe8-846e-affc6ece7871 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105852025-01-06T20:40:51.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b0164bd1-8891-4637-b329-8a0c21c16a2d roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105862025-01-06T20:40:51.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b0164bd1-8891-4637-b329-8a0c21c16a2d resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105872025-01-06T20:40:51.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = b0164bd1-8891-4637-b329-8a0c21c16a2d response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105882025-01-06T20:40:52.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1208d1e8-0159-48aa-bc01-9ff35ef584e8 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105892025-01-06T20:40:52.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1208d1e8-0159-48aa-bc01-9ff35ef584e8 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105902025-01-06T20:40:52.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 1208d1e8-0159-48aa-bc01-9ff35ef584e8 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105912025-01-06T20:40:53.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3bb17267-bdb5-42ce-8096-e60ecfadd530 roles = RoleSet { roles: {} } uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105922025-01-06T20:40:53.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3bb17267-bdb5-42ce-8096-e60ecfadd530 resource = Database result = Ok(()) uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90
105932025-01-06T20:40:53.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2533 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:40048 req_id = 3bb17267-bdb5-42ce-8096-e60ecfadd530 response_code = 200 uri = /probes/346c1d3f-8af0-46bf-8798-77d7bb811a90