Max level shown:
12024-09-05T00:45:03.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 872ccb97-0a74-49c0-93ff-99c519a8a386 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
22024-09-05T00:45:03.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 872ccb97-0a74-49c0-93ff-99c519a8a386 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
32024-09-05T00:45:03.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 872ccb97-0a74-49c0-93ff-99c519a8a386 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
42024-09-05T00:45:04.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 327b418d-3409-4900-95df-c719a6aa48d9 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52024-09-05T00:45:04.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 327b418d-3409-4900-95df-c719a6aa48d9 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
62024-09-05T00:45:04.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 327b418d-3409-4900-95df-c719a6aa48d9 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
72024-09-05T00:45:04.951ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
82024-09-05T00:45:04.951ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92024-09-05T00:45:04.951ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
102024-09-05T00:45:04.951ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112024-09-05T00:45:04.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
122024-09-05T00:45:04.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
132024-09-05T00:45:04.952ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
142024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
152024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
162024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
172024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
182024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
192024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
202024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
212024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
222024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
232024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
242024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
252024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
262024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
272024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
282024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
292024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
302024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
312024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
322024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
332024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
342024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
352024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
362024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
372024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
382024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
392024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
402024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
412024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
422024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
432024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
442024-09-05T00:45:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
452024-09-05T00:45:04.954ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3567, tv_nsec: 22682303 } })
462024-09-05T00:45:04.954ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3567, tv_nsec: 22759544 } })
472024-09-05T00:45:04.956ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.697606ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
482024-09-05T00:45:04.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
492024-09-05T00:45:04.956ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
502024-09-05T00:45:04.956ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
512024-09-05T00:45:04.956ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
522024-09-05T00:45:04.956ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
532024-09-05T00:45:04.957ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
542024-09-05T00:45:04.957ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
552024-09-05T00:45:04.957ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
562024-09-05T00:45:04.958ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
572024-09-05T00:45:04.958ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
582024-09-05T00:45:04.958ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
592024-09-05T00:45:04.958ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
602024-09-05T00:45:04.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
612024-09-05T00:45:04.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
622024-09-05T00:45:04.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
632024-09-05T00:45:04.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
642024-09-05T00:45:04.959ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
652024-09-05T00:45:04.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
662024-09-05T00:45:04.959ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
672024-09-05T00:45:04.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
682024-09-05T00:45:04.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
692024-09-05T00:45:04.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
702024-09-05T00:45:04.959ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
712024-09-05T00:45:04.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
722024-09-05T00:45:04.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
732024-09-05T00:45:04.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
742024-09-05T00:45:04.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
752024-09-05T00:45:04.964ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
762024-09-05T00:45:04.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
772024-09-05T00:45:04.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
782024-09-05T00:45:04.967ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
792024-09-05T00:45:04.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
802024-09-05T00:45:04.968ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3567, tv_nsec: 36630491 } })
812024-09-05T00:45:04.968ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
822024-09-05T00:45:04.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
832024-09-05T00:45:04.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
842024-09-05T00:45:04.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
852024-09-05T00:45:04.970ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
862024-09-05T00:45:04.970ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
872024-09-05T00:45:04.971ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
882024-09-05T00:45:04.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
892024-09-05T00:45:04.973ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
902024-09-05T00:45:04.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
912024-09-05T00:45:04.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
922024-09-05T00:45:04.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
932024-09-05T00:45:04.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
942024-09-05T00:45:04.985ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
952024-09-05T00:45:04.985ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.552212ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
962024-09-05T00:45:04.996ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 38.401734ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
972024-09-05T00:45:04.997ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
982024-09-05T00:45:04.997ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
992024-09-05T00:45:04.997ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1002024-09-05T00:45:04.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1012024-09-05T00:45:04.998ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1022024-09-05T00:45:05.001ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1032024-09-05T00:45:05.001ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1042024-09-05T00:45:05.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1052024-09-05T00:45:05.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1062024-09-05T00:45:05.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1072024-09-05T00:45:05.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1082024-09-05T00:45:05.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1092024-09-05T00:45:05.003ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1102024-09-05T00:45:05.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1112024-09-05T00:45:05.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1122024-09-05T00:45:05.005ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1132024-09-05T00:45:05.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1142024-09-05T00:45:05.005ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1152024-09-05T00:45:05.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1162024-09-05T00:45:05.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1172024-09-05T00:45:05.008ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1182024-09-05T00:45:05.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1192024-09-05T00:45:05.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.994257ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1202024-09-05T00:45:05.019ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 61.144888ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
1212024-09-05T00:45:05.021ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1843 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = a294aff6-7338-471a-9917-5b99b6b19b61 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
1222024-09-05T00:45:05.035ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
1232024-09-05T00:45:05.035ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
1242024-09-05T00:45:05.035ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 81.253067ms iteration = 6 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
1252024-09-05T00:45:05.039ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 85.301359ms iteration = 6 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
1262024-09-05T00:45:05.041ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1272024-09-05T00:45:05.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1282024-09-05T00:45:05.043ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1292024-09-05T00:45:05.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1302024-09-05T00:45:05.044ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1312024-09-05T00:45:05.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1322024-09-05T00:45:05.049ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1332024-09-05T00:45:05.049ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 95.720884ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1342024-09-05T00:45:05.054ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
1352024-09-05T00:45:05.054ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1362024-09-05T00:45:05.054ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bf1ab92d-cded-4e46-a836-1de39beb81cf", "content-length": "26", "date": "Thu, 05 Sep 2024 00:45:04 GMT"} })
1372024-09-05T00:45:05.054ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1382024-09-05T00:45:05.056ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1392024-09-05T00:45:05.062ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
1402024-09-05T00:45:05.062ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1412024-09-05T00:45:05.063ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d38e8dbf-f3cc-4434-9fa8-71b373a4459e", "content-length": "26", "date": "Thu, 05 Sep 2024 00:45:04 GMT"} })
1422024-09-05T00:45:05.063ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1432024-09-05T00:45:05.065ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1442024-09-05T00:45:05.070ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1452024-09-05T00:45:05.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1462024-09-05T00:45:05.073ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 119.6598ms iteration = 9 status = {"physical_disks_added":0}
1472024-09-05T00:45:05.076ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b zone_address = fd00:1122:3344:101::2
1482024-09-05T00:45:05.076ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1492024-09-05T00:45:05.076ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7ab319bb-ca38-4c72-aec0-313d8bf3ba79", "content-length": "26", "date": "Thu, 05 Sep 2024 00:45:04 GMT"} })
1502024-09-05T00:45:05.076ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1512024-09-05T00:45:05.077ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
1522024-09-05T00:45:05.118ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1532024-09-05T00:45:05.121ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f9d9366e-5a3e-432d-af36-ea78d18a02c8", "content-length": "372", "date": "Thu, 05 Sep 2024 00:45:05 GMT"} })
1542024-09-05T00:45:05.121ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1552024-09-05T00:45:05.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1562024-09-05T00:45:05.124ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1572024-09-05T00:45:05.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1582024-09-05T00:45:05.127ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1592024-09-05T00:45:05.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1602024-09-05T00:45:05.135ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1612024-09-05T00:45:05.136ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "413bb854-a9b2-4d29-8c3b-73c781ddd5d5", "date": "Thu, 05 Sep 2024 00:45:05 GMT"} })
1622024-09-05T00:45:05.137ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 183.202852ms iteration = 7 status = {}
1632024-09-05T00:45:05.150ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1642024-09-05T00:45:05.153ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a014d257-275c-449e-a4f4-aef00eab141c, lookup_type: ById(a014d257-275c-449e-a4f4-aef00eab141c) } result = Ok(())
1652024-09-05T00:45:05.153ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1662024-09-05T00:45:05.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1672024-09-05T00:45:05.155ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 201.08062ms iteration = 6 status = 0
1682024-09-05T00:45:05.155ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
1692024-09-05T00:45:05.155ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 197.933054ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
1702024-09-05T00:45:05.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1712024-09-05T00:45:05.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1722024-09-05T00:45:05.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1732024-09-05T00:45:05.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1742024-09-05T00:45:05.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1752024-09-05T00:45:05.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1762024-09-05T00:45:05.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1772024-09-05T00:45:05.208ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1782024-09-05T00:45:05.208ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1792024-09-05T00:45:05.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1802024-09-05T00:45:05.223ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
1812024-09-05T00:45:05.224ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6fd1f368-a104-49c2-9cbb-f1b0220cd05c", "content-length": "1", "date": "Thu, 05 Sep 2024 00:45:05 GMT"} })
1822024-09-05T00:45:05.226ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1832024-09-05T00:45:05.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1842024-09-05T00:45:05.227ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 276.416721ms iteration = 6 status = null
1852024-09-05T00:45:05.240ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:55503
1862024-09-05T00:45:05.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55503 req_id = 5abf3a4c-cef9-4674-a792-913f2c6ca819 roles = RoleSet { roles: {} } uri = /metrics/producers
1872024-09-05T00:45:05.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55503 req_id = 5abf3a4c-cef9-4674-a792-913f2c6ca819 resource = Database result = Ok(()) uri = /metrics/producers
1882024-09-05T00:45:05.250ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 298.681617ms iteration = 6 status = {}
1892024-09-05T00:45:05.300ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
1902024-09-05T00:45:05.301ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "69228052-ea51-490a-bd80-9a7d91e2310f", "content-length": "691", "date": "Thu, 05 Sep 2024 00:45:04 GMT"} })
1912024-09-05T00:45:05.301ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
1922024-09-05T00:45:05.301ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
1932024-09-05T00:45:05.301ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
1942024-09-05T00:45:05.302ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 348.700758ms iteration = 6 status = {}
1952024-09-05T00:45:05.322ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
1962024-09-05T00:45:05.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55503 req_id = 5abf3a4c-cef9-4674-a792-913f2c6ca819 roles = RoleSet { roles: {} } uri = /metrics/producers
1972024-09-05T00:45:05.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55503 req_id = 5abf3a4c-cef9-4674-a792-913f2c6ca819 resource = Database result = Ok(()) uri = /metrics/producers
1982024-09-05T00:45:05.329ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1992024-09-05T00:45:05.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2002024-09-05T00:45:05.331ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 3013d0b1-47fb-4df1-97e5-7049d1043033, rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c4762fe-488f-4054-979a-f54d371ea654) } rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
2012024-09-05T00:45:05.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2022024-09-05T00:45:05.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2032024-09-05T00:45:05.343ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2042024-09-05T00:45:05.343ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ac354a8a-185a-491f-8cc6-edc1629e93aa", "content-length": "121", "date": "Thu, 05 Sep 2024 00:45:05 GMT"} })
2052024-09-05T00:45:05.343ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
2062024-09-05T00:45:05.343ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c4762fe-488f-4054-979a-f54d371ea654
2072024-09-05T00:45:05.344ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2082024-09-05T00:45:05.344ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2092024-09-05T00:45:05.344ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
2102024-09-05T00:45:05.344ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
2112024-09-05T00:45:05.344ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
2122024-09-05T00:45:05.344ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2132024-09-05T00:45:05.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2142024-09-05T00:45:05.346ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2152024-09-05T00:45:05.346ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "21b3e87d-91e4-499a-9703-1b2e56ebe07a", "content-length": "2", "date": "Thu, 05 Sep 2024 00:45:05 GMT"} })
2162024-09-05T00:45:05.346ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2172024-09-05T00:45:05.346ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a39273ac-47ee-4f26-9d46-74c4486c651a", "content-length": "51", "date": "Thu, 05 Sep 2024 00:45:05 GMT"} })
2182024-09-05T00:45:05.346ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
2192024-09-05T00:45:05.346ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2202024-09-05T00:45:05.351ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
2212024-09-05T00:45:05.352ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ac28c673-e113-463d-8cae-cba9603e8725", "date": "Thu, 05 Sep 2024 00:45:05 GMT"} })
2222024-09-05T00:45:05.352ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = c2d58162-25ee-4e2a-9e85-e5ea2d681d4d
2232024-09-05T00:45:05.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 112575 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55503 req_id = 5abf3a4c-cef9-4674-a792-913f2c6ca819 response_code = 201 uri = /metrics/producers
2242024-09-05T00:45:05.441ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "902edacd-9851-4738-a394-5136fcff5dee", "date": "Thu, 05 Sep 2024 00:45:04 GMT"} })
2252024-09-05T00:45:05.441ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch = Switch0
2262024-09-05T00:45:05.441ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2272024-09-05T00:45:05.441ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "71c02870-b104-4749-92a7-78fe4ca4bc5a", "content-length": "667", "date": "Thu, 05 Sep 2024 00:45:04 GMT"} })
2282024-09-05T00:45:05.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2292024-09-05T00:45:05.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2302024-09-05T00:45:05.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2312024-09-05T00:45:05.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2322024-09-05T00:45:05.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2332024-09-05T00:45:05.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2342024-09-05T00:45:05.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2352024-09-05T00:45:05.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2362024-09-05T00:45:05.461ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 507.147379ms iteration = 6 status = {}
2372024-09-05T00:45:05.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d4abd43a-bce7-4a3c-b76e-0bbd1ce85c81 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2382024-09-05T00:45:05.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d4abd43a-bce7-4a3c-b76e-0bbd1ce85c81 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2392024-09-05T00:45:05.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d4abd43a-bce7-4a3c-b76e-0bbd1ce85c81 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2402024-09-05T00:45:05.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 658e6dbb-b252-4bc2-941b-dc80f815477e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
2412024-09-05T00:45:05.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 658e6dbb-b252-4bc2-941b-dc80f815477e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
2422024-09-05T00:45:05.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2416 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 658e6dbb-b252-4bc2-941b-dc80f815477e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
2432024-09-05T00:45:06.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ccb7a91c-cb21-4a99-8f9d-5c56b437e8c4 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2442024-09-05T00:45:06.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ccb7a91c-cb21-4a99-8f9d-5c56b437e8c4 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2452024-09-05T00:45:06.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ccb7a91c-cb21-4a99-8f9d-5c56b437e8c4 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2462024-09-05T00:45:07.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1463b39b-cbd1-45b3-b9c0-85018c0f8f7f roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2472024-09-05T00:45:07.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1463b39b-cbd1-45b3-b9c0-85018c0f8f7f resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2482024-09-05T00:45:07.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1463b39b-cbd1-45b3-b9c0-85018c0f8f7f response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2492024-09-05T00:45:08.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 026e6836-a429-4028-81d9-65a1ef5751b3 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2502024-09-05T00:45:08.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 026e6836-a429-4028-81d9-65a1ef5751b3 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2512024-09-05T00:45:08.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 026e6836-a429-4028-81d9-65a1ef5751b3 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2522024-09-05T00:45:09.404ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:55065
2532024-09-05T00:45:09.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55065 req_id = d7f3c3b3-7929-4469-be1e-80c8a65269e4 roles = RoleSet { roles: {} } uri = /metrics/producers
2542024-09-05T00:45:09.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55065 req_id = d7f3c3b3-7929-4469-be1e-80c8a65269e4 resource = Database result = Ok(()) uri = /metrics/producers
2552024-09-05T00:45:09.437ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
2562024-09-05T00:45:09.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55065 req_id = d7f3c3b3-7929-4469-be1e-80c8a65269e4 roles = RoleSet { roles: {} } uri = /metrics/producers
2572024-09-05T00:45:09.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55065 req_id = d7f3c3b3-7929-4469-be1e-80c8a65269e4 resource = Database result = Ok(()) uri = /metrics/producers
2582024-09-05T00:45:09.468ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
2592024-09-05T00:45:09.469ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ff55aeeb-282e-49fc-8204-a45a176ae769", "date": "Thu, 05 Sep 2024 00:45:09 GMT"} })
2602024-09-05T00:45:09.469ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = 9c3576f2-3ad5-4e30-a194-86e7ba23efdd
2612024-09-05T00:45:09.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 65055 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55065 req_id = d7f3c3b3-7929-4469-be1e-80c8a65269e4 response_code = 201 uri = /metrics/producers
2622024-09-05T00:45:09.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 70c26de4-7222-4dd3-9eb9-b87ffe4a1b57 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2632024-09-05T00:45:09.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 70c26de4-7222-4dd3-9eb9-b87ffe4a1b57 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2642024-09-05T00:45:09.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 70c26de4-7222-4dd3-9eb9-b87ffe4a1b57 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2652024-09-05T00:45:10.495ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:50954
2662024-09-05T00:45:10.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50954 req_id = 8779558d-b0f2-4234-ab23-7b412e56977a roles = RoleSet { roles: {} } uri = /metrics/producers
2672024-09-05T00:45:10.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50954 req_id = 8779558d-b0f2-4234-ab23-7b412e56977a resource = Database result = Ok(()) uri = /metrics/producers
2682024-09-05T00:45:10.529ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
2692024-09-05T00:45:10.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50954 req_id = 8779558d-b0f2-4234-ab23-7b412e56977a roles = RoleSet { roles: {} } uri = /metrics/producers
2702024-09-05T00:45:10.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50954 req_id = 8779558d-b0f2-4234-ab23-7b412e56977a resource = Database result = Ok(()) uri = /metrics/producers
2712024-09-05T00:45:10.576ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
2722024-09-05T00:45:10.577ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2438c1d9-4cfc-47db-97e5-a14eb28ed6cd", "date": "Thu, 05 Sep 2024 00:45:10 GMT"} })
2732024-09-05T00:45:10.577ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = 35429cca-496a-49ba-952c-5eef2f1c42c8
2742024-09-05T00:45:10.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 82691 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50954 req_id = 8779558d-b0f2-4234-ab23-7b412e56977a response_code = 201 uri = /metrics/producers
2752024-09-05T00:45:10.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f5928e12-0a5b-4a12-97e7-3f5cea4efff6 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2762024-09-05T00:45:10.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f5928e12-0a5b-4a12-97e7-3f5cea4efff6 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2772024-09-05T00:45:10.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f5928e12-0a5b-4a12-97e7-3f5cea4efff6 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2782024-09-05T00:45:11.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = edce2ae7-21f3-42a9-aa38-4f1938a665ea roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2792024-09-05T00:45:11.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = edce2ae7-21f3-42a9-aa38-4f1938a665ea resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2802024-09-05T00:45:11.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2591 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = edce2ae7-21f3-42a9-aa38-4f1938a665ea response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2812024-09-05T00:45:12.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3071c0a6-2925-4e50-a57d-7b5761dfd861 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2822024-09-05T00:45:12.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3071c0a6-2925-4e50-a57d-7b5761dfd861 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2832024-09-05T00:45:12.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3071c0a6-2925-4e50-a57d-7b5761dfd861 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2842024-09-05T00:45:13.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2b92b356-ccb1-4082-846b-a26edbacd3c3 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2852024-09-05T00:45:13.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2b92b356-ccb1-4082-846b-a26edbacd3c3 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2862024-09-05T00:45:13.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2b92b356-ccb1-4082-846b-a26edbacd3c3 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2872024-09-05T00:45:14.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5930ac42-a452-4771-afed-fe2b810ba00c roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2882024-09-05T00:45:14.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5930ac42-a452-4771-afed-fe2b810ba00c resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2892024-09-05T00:45:14.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5930ac42-a452-4771-afed-fe2b810ba00c response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
2902024-09-05T00:45:14.953ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
2912024-09-05T00:45:14.953ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
2922024-09-05T00:45:14.953ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2932024-09-05T00:45:14.953ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2942024-09-05T00:45:14.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2952024-09-05T00:45:14.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2962024-09-05T00:45:14.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2972024-09-05T00:45:14.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2982024-09-05T00:45:14.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2992024-09-05T00:45:14.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3002024-09-05T00:45:14.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3012024-09-05T00:45:14.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3022024-09-05T00:45:14.979ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3032024-09-05T00:45:14.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3042024-09-05T00:45:14.985ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3052024-09-05T00:45:14.988ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
3062024-09-05T00:45:14.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3072024-09-05T00:45:14.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3082024-09-05T00:45:14.989ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
3092024-09-05T00:45:14.989ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
3102024-09-05T00:45:14.997ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
3112024-09-05T00:45:14.997ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.727399ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
3122024-09-05T00:45:15.009ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.033348ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3132024-09-05T00:45:15.021ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1286 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 7a197298-c624-412a-bdf3-3593b9e8c1d7 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
3142024-09-05T00:45:15.022ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
3152024-09-05T00:45:15.022ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:62689
3162024-09-05T00:45:15.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62689 req_id = 3e482f81-575c-4640-8785-f1b256ee5ce5 roles = RoleSet { roles: {} } uri = /metrics/producers
3172024-09-05T00:45:15.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62689 req_id = 3e482f81-575c-4640-8785-f1b256ee5ce5 resource = Database result = Ok(()) uri = /metrics/producers
3182024-09-05T00:45:15.062ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
3192024-09-05T00:45:15.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62689 req_id = 3e482f81-575c-4640-8785-f1b256ee5ce5 roles = RoleSet { roles: {} } uri = /metrics/producers
3202024-09-05T00:45:15.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62689 req_id = 3e482f81-575c-4640-8785-f1b256ee5ce5 resource = Database result = Ok(()) uri = /metrics/producers
3212024-09-05T00:45:15.089ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
3222024-09-05T00:45:15.090ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "21dbf0af-d007-4eef-8bff-03b582cdc713", "date": "Thu, 05 Sep 2024 00:45:15 GMT"} })
3232024-09-05T00:45:15.090ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
3242024-09-05T00:45:15.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 69231 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:62689 req_id = 3e482f81-575c-4640-8785-f1b256ee5ce5 response_code = 201 uri = /metrics/producers
3252024-09-05T00:45:15.092ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "3e482f81-575c-4640-8785-f1b256ee5ce5", "content-length": "41", "date": "Thu, 05 Sep 2024 00:45:14 GMT"} })
3262024-09-05T00:45:15.093ZDEBGnexus (producer-registration-task): registered with nexus successfully
3272024-09-05T00:45:15.093ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
3282024-09-05T00:45:15.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a0fb319e-58d0-4fdc-816a-d87192456ae0 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3292024-09-05T00:45:15.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a0fb319e-58d0-4fdc-816a-d87192456ae0 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3302024-09-05T00:45:15.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2488 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a0fb319e-58d0-4fdc-816a-d87192456ae0 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3312024-09-05T00:45:16.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c2edafea-57e1-4569-a152-51144e4089bb roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3322024-09-05T00:45:16.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c2edafea-57e1-4569-a152-51144e4089bb resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3332024-09-05T00:45:16.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c2edafea-57e1-4569-a152-51144e4089bb response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3342024-09-05T00:45:17.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 37004dcf-4b0e-42f4-aa0c-cdd4f06a76af roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3352024-09-05T00:45:17.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 37004dcf-4b0e-42f4-aa0c-cdd4f06a76af resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3362024-09-05T00:45:17.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 37004dcf-4b0e-42f4-aa0c-cdd4f06a76af response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3372024-09-05T00:45:18.582ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45114
3382024-09-05T00:45:18.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45114 req_id = 7de1b71c-8a0f-442a-8a47-f16ae081478e roles = RoleSet { roles: {} } uri = /metrics/producers
3392024-09-05T00:45:18.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45114 req_id = 7de1b71c-8a0f-442a-8a47-f16ae081478e resource = Database result = Ok(()) uri = /metrics/producers
3402024-09-05T00:45:18.614ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
3412024-09-05T00:45:18.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45114 req_id = 7de1b71c-8a0f-442a-8a47-f16ae081478e roles = RoleSet { roles: {} } uri = /metrics/producers
3422024-09-05T00:45:18.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45114 req_id = 7de1b71c-8a0f-442a-8a47-f16ae081478e resource = Database result = Ok(()) uri = /metrics/producers
3432024-09-05T00:45:18.622ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
3442024-09-05T00:45:18.622ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9d2315d6-f5c8-46e3-998a-e881b7d43f89", "date": "Thu, 05 Sep 2024 00:45:18 GMT"} })
3452024-09-05T00:45:18.622ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = 42b3183c-16e5-4e5a-9353-cb1f595a1c67
3462024-09-05T00:45:18.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 41938 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45114 req_id = 7de1b71c-8a0f-442a-8a47-f16ae081478e response_code = 201 uri = /metrics/producers
3472024-09-05T00:45:19.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b69c1eea-2dde-4cf4-91d7-40d06ce18e1e roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3482024-09-05T00:45:19.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b69c1eea-2dde-4cf4-91d7-40d06ce18e1e resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3492024-09-05T00:45:19.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b69c1eea-2dde-4cf4-91d7-40d06ce18e1e response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3502024-09-05T00:45:20.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c07fce8c-cbd4-4a56-89fb-1f1f5d0cb766 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3512024-09-05T00:45:20.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c07fce8c-cbd4-4a56-89fb-1f1f5d0cb766 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3522024-09-05T00:45:20.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c07fce8c-cbd4-4a56-89fb-1f1f5d0cb766 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3532024-09-05T00:45:21.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c53cf464-6d6f-4432-a382-b9c59425e823 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3542024-09-05T00:45:21.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c53cf464-6d6f-4432-a382-b9c59425e823 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3552024-09-05T00:45:21.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c53cf464-6d6f-4432-a382-b9c59425e823 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3562024-09-05T00:45:22.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3e876f35-1d59-4052-b583-31308ed1048f roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3572024-09-05T00:45:22.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3e876f35-1d59-4052-b583-31308ed1048f resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3582024-09-05T00:45:22.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3e876f35-1d59-4052-b583-31308ed1048f response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3592024-09-05T00:45:23.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 19e184a6-be4a-49e5-9ae0-4009cb9fcd6d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3602024-09-05T00:45:23.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 19e184a6-be4a-49e5-9ae0-4009cb9fcd6d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3612024-09-05T00:45:23.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 19e184a6-be4a-49e5-9ae0-4009cb9fcd6d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3622024-09-05T00:45:24.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fab2195c-40fd-45ab-81d0-b8c70e4e4995 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3632024-09-05T00:45:24.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fab2195c-40fd-45ab-81d0-b8c70e4e4995 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3642024-09-05T00:45:24.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1762 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fab2195c-40fd-45ab-81d0-b8c70e4e4995 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3652024-09-05T00:45:24.954ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
3662024-09-05T00:45:24.954ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
3672024-09-05T00:45:24.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3682024-09-05T00:45:24.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3692024-09-05T00:45:24.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3702024-09-05T00:45:24.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3712024-09-05T00:45:24.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3722024-09-05T00:45:24.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3732024-09-05T00:45:24.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3742024-09-05T00:45:24.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3752024-09-05T00:45:24.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3762024-09-05T00:45:24.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3772024-09-05T00:45:24.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.998359ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3782024-09-05T00:45:24.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3792024-09-05T00:45:24.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3802024-09-05T00:45:24.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3812024-09-05T00:45:24.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
3822024-09-05T00:45:24.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3832024-09-05T00:45:24.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3842024-09-05T00:45:24.971ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
3852024-09-05T00:45:24.971ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.958982ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
3862024-09-05T00:45:25.093ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1644 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 60297645-989a-4e4c-980f-2d7d612ab77c response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
3872024-09-05T00:45:25.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c57b063b-22ab-4437-bf8a-f4f36460a05b roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3882024-09-05T00:45:25.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c57b063b-22ab-4437-bf8a-f4f36460a05b resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3892024-09-05T00:45:25.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1826 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c57b063b-22ab-4437-bf8a-f4f36460a05b response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3902024-09-05T00:45:26.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3a2ba66a-5ff3-4fdc-843f-8e17e653b1e2 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3912024-09-05T00:45:26.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3a2ba66a-5ff3-4fdc-843f-8e17e653b1e2 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3922024-09-05T00:45:26.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3a2ba66a-5ff3-4fdc-843f-8e17e653b1e2 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3932024-09-05T00:45:27.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1ba00f23-2428-460f-8de3-614e0234d611 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3942024-09-05T00:45:27.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1ba00f23-2428-460f-8de3-614e0234d611 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3952024-09-05T00:45:27.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1ba00f23-2428-460f-8de3-614e0234d611 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3962024-09-05T00:45:28.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ed5030a7-e046-4421-8978-da60e910d6ad roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3972024-09-05T00:45:28.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ed5030a7-e046-4421-8978-da60e910d6ad resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3982024-09-05T00:45:28.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ed5030a7-e046-4421-8978-da60e910d6ad response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
3992024-09-05T00:45:29.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 99999877-9e5e-4a79-9ed9-dd1ff6950596 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4002024-09-05T00:45:29.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 99999877-9e5e-4a79-9ed9-dd1ff6950596 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4012024-09-05T00:45:29.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 99999877-9e5e-4a79-9ed9-dd1ff6950596 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4022024-09-05T00:45:30.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5f125833-56b7-4bb2-a880-111f5023a580 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4032024-09-05T00:45:30.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5f125833-56b7-4bb2-a880-111f5023a580 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4042024-09-05T00:45:30.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1498 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5f125833-56b7-4bb2-a880-111f5023a580 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4052024-09-05T00:45:31.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7b9ada98-cd8a-4995-8bb0-e02a35085cfb roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4062024-09-05T00:45:31.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7b9ada98-cd8a-4995-8bb0-e02a35085cfb resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4072024-09-05T00:45:31.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7b9ada98-cd8a-4995-8bb0-e02a35085cfb response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4082024-09-05T00:45:32.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5f7ce2b6-1a20-4a70-b8ad-ecc9d8fb2f49 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4092024-09-05T00:45:32.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5f7ce2b6-1a20-4a70-b8ad-ecc9d8fb2f49 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4102024-09-05T00:45:32.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4479 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5f7ce2b6-1a20-4a70-b8ad-ecc9d8fb2f49 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4112024-09-05T00:45:33.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 96dfdcb2-4155-4e04-a321-6351c2f1fc53 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4122024-09-05T00:45:33.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 96dfdcb2-4155-4e04-a321-6351c2f1fc53 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4132024-09-05T00:45:33.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 96dfdcb2-4155-4e04-a321-6351c2f1fc53 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4142024-09-05T00:45:34.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0af8f062-c350-4874-8bbd-12fa0205655e roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4152024-09-05T00:45:34.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0af8f062-c350-4874-8bbd-12fa0205655e resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4162024-09-05T00:45:34.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1894 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0af8f062-c350-4874-8bbd-12fa0205655e response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
4172024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
4182024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
4192024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4202024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4212024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
4222024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
4232024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
4242024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
4252024-09-05T00:45:34.952ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-05 00:35:34.952653316 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4262024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
4272024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4282024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4292024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
4302024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4312024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4322024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
4332024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
4342024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4352024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4362024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
4372024-09-05T00:45:34.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4382024-09-05T00:45:34.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4392024-09-05T00:45:34.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4402024-09-05T00:45:34.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4412024-09-05T00:45:34.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4422024-09-05T00:45:34.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4432024-09-05T00:45:34.953ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("145d6d08-bb1c-4557-af3d-b3b8e647b114.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4aa18504-a7e8-4aa1-94fe-a65abab62a4b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("4aa18504-a7e8-4aa1-94fe-a65abab62a4b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3597, tv_nsec: 20906338 } })
4442024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
4452024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
4462024-09-05T00:45:34.954ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59
4472024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
4482024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4492024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.99\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59"}
4502024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4512024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
4522024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
4532024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4542024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
4552024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4562024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4572024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
4582024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4592024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
4602024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4612024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
4622024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4632024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
4642024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4652024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
4662024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4672024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4682024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
4692024-09-05T00:45:34.954ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4702024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4712024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
4722024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4732024-09-05T00:45:34.954ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c51ae87-cbaf-4403-8e7a-91ae1f6a480f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89145bfe-85a8-47ae-9826-e73f4757fe92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("972980d1-78ce-4b3e-8b23-36e1a0e30ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("972980d1-78ce-4b3e-8b23-36e1a0e30ffb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 3597, tv_nsec: 22445706 } })
4742024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4752024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4762024-09-05T00:45:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4772024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4782024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4792024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4802024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4812024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4822024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4832024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4842024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4852024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4862024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4872024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4882024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4892024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4902024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4912024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4922024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4932024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.79561ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4942024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4952024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4962024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
4972024-09-05T00:45:34.955ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.36478ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4982024-09-05T00:45:34.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4992024-09-05T00:45:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5002024-09-05T00:45:34.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5012024-09-05T00:45:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5022024-09-05T00:45:34.957ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
5032024-09-05T00:45:34.957ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.509271ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
5042024-09-05T00:45:34.957ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-05 00:35:34.952653316 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5052024-09-05T00:45:34.957ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.602592ms iteration = 4 status = {"expiration":"2024-09-05T00:35:34.952653316Z","pruned":[]}
5062024-09-05T00:45:34.957ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
5072024-09-05T00:45:34.957ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5082024-09-05T00:45:34.957ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
5092024-09-05T00:45:34.957ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5102024-09-05T00:45:34.957ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
5112024-09-05T00:45:34.957ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
5122024-09-05T00:45:34.957ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
5132024-09-05T00:45:34.957ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
5142024-09-05T00:45:34.957ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
5152024-09-05T00:45:34.957ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
5162024-09-05T00:45:34.957ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
5172024-09-05T00:45:34.957ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5182024-09-05T00:45:34.957ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3597, tv_nsec: 25323737 } })
5192024-09-05T00:45:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5202024-09-05T00:45:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5212024-09-05T00:45:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5222024-09-05T00:45:34.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5232024-09-05T00:45:34.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5242024-09-05T00:45:34.958ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
5252024-09-05T00:45:34.958ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5262024-09-05T00:45:34.958ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5272024-09-05T00:45:34.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5282024-09-05T00:45:34.960ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5292024-09-05T00:45:34.960ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3597, tv_nsec: 28666857 } })
5302024-09-05T00:45:34.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5312024-09-05T00:45:34.962ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
5322024-09-05T00:45:34.962ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5332024-09-05T00:45:34.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5342024-09-05T00:45:34.962ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5352024-09-05T00:45:34.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5362024-09-05T00:45:34.963ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5372024-09-05T00:45:34.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5382024-09-05T00:45:34.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5392024-09-05T00:45:34.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5402024-09-05T00:45:34.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5412024-09-05T00:45:34.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5422024-09-05T00:45:34.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5432024-09-05T00:45:34.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5442024-09-05T00:45:34.970ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5452024-09-05T00:45:34.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5462024-09-05T00:45:34.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5472024-09-05T00:45:34.975ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.497821ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
5482024-09-05T00:45:34.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5492024-09-05T00:45:34.981ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5502024-09-05T00:45:34.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5512024-09-05T00:45:35.015ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5522024-09-05T00:45:35.017ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5532024-09-05T00:45:35.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5542024-09-05T00:45:35.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5552024-09-05T00:45:35.018ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5562024-09-05T00:45:35.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5572024-09-05T00:45:35.019ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5582024-09-05T00:45:35.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5592024-09-05T00:45:35.020ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5602024-09-05T00:45:35.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5612024-09-05T00:45:35.020ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5622024-09-05T00:45:35.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5632024-09-05T00:45:35.021ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5642024-09-05T00:45:35.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5652024-09-05T00:45:35.021ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
5662024-09-05T00:45:35.021ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
5672024-09-05T00:45:35.021ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5682024-09-05T00:45:35.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5692024-09-05T00:45:35.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5702024-09-05T00:45:35.023ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.498926ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
5712024-09-05T00:45:35.023ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5722024-09-05T00:45:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5732024-09-05T00:45:35.023ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5742024-09-05T00:45:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5752024-09-05T00:45:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5762024-09-05T00:45:35.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5772024-09-05T00:45:35.024ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5782024-09-05T00:45:35.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5792024-09-05T00:45:35.024ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5802024-09-05T00:45:35.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5812024-09-05T00:45:35.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5822024-09-05T00:45:35.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5832024-09-05T00:45:35.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5842024-09-05T00:45:35.026ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5852024-09-05T00:45:35.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5862024-09-05T00:45:35.027ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5872024-09-05T00:45:35.027ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5882024-09-05T00:45:35.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5892024-09-05T00:45:35.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5902024-09-05T00:45:35.028ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5912024-09-05T00:45:35.029ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5922024-09-05T00:45:35.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5932024-09-05T00:45:35.029ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5942024-09-05T00:45:35.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5952024-09-05T00:45:35.029ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5962024-09-05T00:45:35.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5972024-09-05T00:45:35.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5982024-09-05T00:45:35.030ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
5992024-09-05T00:45:35.030ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
6002024-09-05T00:45:35.030ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 72.968349ms iteration = 4 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
6012024-09-05T00:45:35.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6022024-09-05T00:45:35.033ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6032024-09-05T00:45:35.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6042024-09-05T00:45:35.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6052024-09-05T00:45:35.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6062024-09-05T00:45:35.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6072024-09-05T00:45:35.035ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6082024-09-05T00:45:35.035ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6092024-09-05T00:45:35.035ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6102024-09-05T00:45:35.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6112024-09-05T00:45:35.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6122024-09-05T00:45:35.037ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3597, tv_nsec: 105541335 } })
6132024-09-05T00:45:35.038ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
6142024-09-05T00:45:35.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6152024-09-05T00:45:35.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6162024-09-05T00:45:35.043ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6172024-09-05T00:45:35.046ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6182024-09-05T00:45:35.046ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 92.254562ms iteration = 3 status = {"nsuccess":5}
6192024-09-05T00:45:35.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6202024-09-05T00:45:35.047ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6212024-09-05T00:45:35.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6222024-09-05T00:45:35.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6232024-09-05T00:45:35.048ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6242024-09-05T00:45:35.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6252024-09-05T00:45:35.049ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6262024-09-05T00:45:35.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6272024-09-05T00:45:35.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6282024-09-05T00:45:35.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
6292024-09-05T00:45:35.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6302024-09-05T00:45:35.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6312024-09-05T00:45:35.065ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
6322024-09-05T00:45:35.065ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
6332024-09-05T00:45:35.065ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 111.321872ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
6342024-09-05T00:45:35.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6352024-09-05T00:45:35.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6362024-09-05T00:45:35.075ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6372024-09-05T00:45:35.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6382024-09-05T00:45:35.076ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6392024-09-05T00:45:35.076ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6402024-09-05T00:45:35.076ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6412024-09-05T00:45:35.076ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6422024-09-05T00:45:35.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6432024-09-05T00:45:35.078ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6442024-09-05T00:45:35.078ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6452024-09-05T00:45:35.078ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6462024-09-05T00:45:35.078ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6472024-09-05T00:45:35.078ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 124.252572ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6482024-09-05T00:45:35.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6492024-09-05T00:45:35.080ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6502024-09-05T00:45:35.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6512024-09-05T00:45:35.081ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 123.674212ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6522024-09-05T00:45:35.081ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 127.211894ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6532024-09-05T00:45:35.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6542024-09-05T00:45:35.081ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6552024-09-05T00:45:35.081ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6562024-09-05T00:45:35.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6572024-09-05T00:45:35.083ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6582024-09-05T00:45:35.083ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 128.857954ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6592024-09-05T00:45:35.083ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 129.082307ms iteration = 7 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
6602024-09-05T00:45:35.084ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6612024-09-05T00:45:35.084ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6622024-09-05T00:45:35.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6632024-09-05T00:45:35.088ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
6642024-09-05T00:45:35.089ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
6652024-09-05T00:45:35.089ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6662024-09-05T00:45:35.090ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "42b5e948-97a8-4bc2-aaf0-4ab094d4a3d0", "content-length": "26", "date": "Thu, 05 Sep 2024 00:45:34 GMT"} })
6672024-09-05T00:45:35.090ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6682024-09-05T00:45:35.091ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6692024-09-05T00:45:35.091ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
6702024-09-05T00:45:35.091ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6712024-09-05T00:45:35.091ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.716533ms iteration = 7 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
6722024-09-05T00:45:35.091ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6732024-09-05T00:45:35.093ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = dd9b8648-7930-4a11-8aa6-2d8c5f461603 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
6742024-09-05T00:45:35.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6752024-09-05T00:45:35.094ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6762024-09-05T00:45:35.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6772024-09-05T00:45:35.099ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
6782024-09-05T00:45:35.099ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 32541e10-8a85-4410-9858-67a9ab52251d dns_zone_name = oxide.test found_so_far = 0 version = 2
6792024-09-05T00:45:35.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6802024-09-05T00:45:35.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6812024-09-05T00:45:35.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6822024-09-05T00:45:35.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6832024-09-05T00:45:35.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6842024-09-05T00:45:35.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6852024-09-05T00:45:35.109ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
6862024-09-05T00:45:35.109ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6872024-09-05T00:45:35.109ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1f7344a5-2458-4725-b4ff-e2aa84690ec2", "content-length": "26", "date": "Thu, 05 Sep 2024 00:45:34 GMT"} })
6882024-09-05T00:45:35.109ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6892024-09-05T00:45:35.110ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 32541e10-8a85-4410-9858-67a9ab52251d dns_zone_name = oxide.test found_so_far = 1 version = 2
6902024-09-05T00:45:35.110ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
6912024-09-05T00:45:35.110ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-05 00:42:43.837540 UTC dns_group = external generation = 2
6922024-09-05T00:45:35.110ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 157.779048ms iteration = 5 status = {"generation":2}
6932024-09-05T00:45:35.111ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6942024-09-05T00:45:35.113ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6952024-09-05T00:45:35.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6962024-09-05T00:45:35.121ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
6972024-09-05T00:45:35.121ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 164.246824ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
6982024-09-05T00:45:35.124ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
6992024-09-05T00:45:35.124ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 59a6be26-b8fa-4e7a-8244-7a4e92426c26 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7002024-09-05T00:45:35.124ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7012024-09-05T00:45:35.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7022024-09-05T00:45:35.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7032024-09-05T00:45:35.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a014d257-275c-449e-a4f4-aef00eab141c, lookup_type: ById(a014d257-275c-449e-a4f4-aef00eab141c) } result = Ok(())
7042024-09-05T00:45:35.128ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7052024-09-05T00:45:35.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7062024-09-05T00:45:35.130ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-05T00:42:33.143008Z, time_modified: 2024-09-05T00:42:33.143008Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2d4fccaa-0031-45b8-a053-9531608bab06, db_silo: Silo { identity: SiloIdentity { id: 2d4fccaa-0031-45b8-a053-9531608bab06, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-05T00:42:43.791199Z, time_modified: 2024-09-05T00:42:43.791199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2d4fccaa-0031-45b8-a053-9531608bab06, db_silo: Silo { identity: SiloIdentity { id: 2d4fccaa-0031-45b8-a053-9531608bab06, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-05T00:42:43.791199Z, time_modified: 2024-09-05T00:42:43.791199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017" }] }) }
7072024-09-05T00:45:35.130ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 178.180881ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2d4fccaa-0031-45b8-a053-9531608bab06","tls_certs":["a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017"]}},"default_endpoint":{"silo_id":"2d4fccaa-0031-45b8-a053-9531608bab06","tls_certs":["a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
7082024-09-05T00:45:35.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7092024-09-05T00:45:35.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7102024-09-05T00:45:35.134ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7112024-09-05T00:45:35.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7122024-09-05T00:45:35.172ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 217.698855ms iteration = 10 status = {"physical_disks_added":0}
7132024-09-05T00:45:35.206ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b zone_address = fd00:1122:3344:101::2
7142024-09-05T00:45:35.206ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7152024-09-05T00:45:35.207ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "509aa507-3806-44e0-adbe-eb5e567575d4", "content-length": "26", "date": "Thu, 05 Sep 2024 00:45:34 GMT"} })
7162024-09-05T00:45:35.207ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7172024-09-05T00:45:35.208ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
7182024-09-05T00:45:35.218ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7192024-09-05T00:45:35.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7202024-09-05T00:45:35.236ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7212024-09-05T00:45:35.260ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 307.977423ms iteration = 7 status = {}
7222024-09-05T00:45:35.292ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7232024-09-05T00:45:35.292ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "02139eb0-2c1c-452f-ac4e-efafdf6e724d", "content-length": "1", "date": "Thu, 05 Sep 2024 00:45:35 GMT"} })
7242024-09-05T00:45:35.294ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7252024-09-05T00:45:35.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7262024-09-05T00:45:35.334ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7272024-09-05T00:45:35.335ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "753bf286-fa56-4b92-8e50-b66514d3d894", "date": "Thu, 05 Sep 2024 00:45:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7282024-09-05T00:45:35.335ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7292024-09-05T00:45:35.337ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "eea5955c-e0b5-4db2-9f58-835c2bda61f4", "date": "Thu, 05 Sep 2024 00:45:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7302024-09-05T00:45:35.337ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7312024-09-05T00:45:35.338ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7322024-09-05T00:45:35.338ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 386.326827ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7332024-09-05T00:45:35.361ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7342024-09-05T00:45:35.361ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c00faac4-f4d7-4e0a-a1da-4f1ad062a032", "content-length": "372", "date": "Thu, 05 Sep 2024 00:45:35 GMT"} })
7352024-09-05T00:45:35.361ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7362024-09-05T00:45:35.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7372024-09-05T00:45:35.361ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
7382024-09-05T00:45:35.363ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7c0869a7-a255-4b8f-9376-57fd8da6b9dd", "date": "Thu, 05 Sep 2024 00:45:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7392024-09-05T00:45:35.363ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7402024-09-05T00:45:35.363ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 408.840548ms iteration = 7 status = 0
7412024-09-05T00:45:35.363ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7422024-09-05T00:45:35.364ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 59a6be26-b8fa-4e7a-8244-7a4e92426c26 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
7432024-09-05T00:45:35.364ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7442024-09-05T00:45:35.364ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-05 00:42:43.011780 UTC dns_group = internal generation = 1
7452024-09-05T00:45:35.364ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 411.572357ms iteration = 5 status = {"generation":1}
7462024-09-05T00:45:35.364ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 411.647758ms iteration = 7 status = null
7472024-09-05T00:45:35.364ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7482024-09-05T00:45:35.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7492024-09-05T00:45:35.365ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7502024-09-05T00:45:35.365ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7512024-09-05T00:45:35.365ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a02b7bf9-fc2e-4cd5-9e77-5a27ce1dd9c2", "date": "Thu, 05 Sep 2024 00:45:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7522024-09-05T00:45:35.365ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7532024-09-05T00:45:35.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7542024-09-05T00:45:35.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e10f540a-1889-4ead-9694-b97dfc16ca9b roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
7552024-09-05T00:45:35.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e10f540a-1889-4ead-9694-b97dfc16ca9b resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
7562024-09-05T00:45:35.366ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7572024-09-05T00:45:35.367ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "80cae8ca-f2ca-40dc-b026-f4f1403a50b3", "date": "Thu, 05 Sep 2024 00:45:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7582024-09-05T00:45:35.367ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7592024-09-05T00:45:35.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7602024-09-05T00:45:35.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7612024-09-05T00:45:35.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e10f540a-1889-4ead-9694-b97dfc16ca9b response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
7622024-09-05T00:45:35.368ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7632024-09-05T00:45:35.368ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7642024-09-05T00:45:35.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7652024-09-05T00:45:35.369ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7662024-09-05T00:45:35.369ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 416.643337ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
7672024-09-05T00:45:35.369ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7682024-09-05T00:45:35.374ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e326f555-7928-4b52-8695-b50882d9b291", "date": "Thu, 05 Sep 2024 00:45:35 GMT"} })
7692024-09-05T00:45:35.376ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 421.534364ms iteration = 8 status = {}
7702024-09-05T00:45:35.432ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7712024-09-05T00:45:35.432ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "11a85edd-e32d-4932-bdff-3656b522d63d", "content-length": "691", "date": "Thu, 05 Sep 2024 00:45:35 GMT"} })
7722024-09-05T00:45:35.432ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
7732024-09-05T00:45:35.432ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
7742024-09-05T00:45:35.432ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
7752024-09-05T00:45:35.433ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 478.728723ms iteration = 7 status = {}
7762024-09-05T00:45:35.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7772024-09-05T00:45:35.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7782024-09-05T00:45:35.453ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 3013d0b1-47fb-4df1-97e5-7049d1043033, rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c4762fe-488f-4054-979a-f54d371ea654) } rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
7792024-09-05T00:45:35.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7802024-09-05T00:45:35.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7812024-09-05T00:45:35.462ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
7822024-09-05T00:45:35.462ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d3c43a58-b490-43e8-a93b-63fda23ca456", "content-length": "121", "date": "Thu, 05 Sep 2024 00:45:35 GMT"} })
7832024-09-05T00:45:35.462ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
7842024-09-05T00:45:35.462ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c4762fe-488f-4054-979a-f54d371ea654
7852024-09-05T00:45:35.463ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
7862024-09-05T00:45:35.463ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
7872024-09-05T00:45:35.463ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
7882024-09-05T00:45:35.463ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
7892024-09-05T00:45:35.463ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
7902024-09-05T00:45:35.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7912024-09-05T00:45:35.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7922024-09-05T00:45:35.465ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
7932024-09-05T00:45:35.465ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "94630937-851d-4e64-b0ad-b7e5314ae1f0", "content-length": "2", "date": "Thu, 05 Sep 2024 00:45:35 GMT"} })
7942024-09-05T00:45:35.465ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
7952024-09-05T00:45:35.465ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "81187455-b919-4b77-8533-cc2e97e4fda5", "content-length": "51", "date": "Thu, 05 Sep 2024 00:45:35 GMT"} })
7962024-09-05T00:45:35.465ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
7972024-09-05T00:45:35.465ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
7982024-09-05T00:45:35.559ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "44444236-6330-4d9f-b8ae-96fe924dbb7a", "date": "Thu, 05 Sep 2024 00:45:35 GMT"} })
7992024-09-05T00:45:35.559ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch = Switch0
8002024-09-05T00:45:35.559ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8012024-09-05T00:45:35.560ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "98fb4806-244b-43aa-81b0-bdc25f611094", "content-length": "667", "date": "Thu, 05 Sep 2024 00:45:35 GMT"} })
8022024-09-05T00:45:35.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8032024-09-05T00:45:35.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8042024-09-05T00:45:35.563ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8052024-09-05T00:45:35.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8062024-09-05T00:45:35.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8072024-09-05T00:45:35.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8082024-09-05T00:45:35.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8092024-09-05T00:45:35.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8102024-09-05T00:45:35.575ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 621.420683ms iteration = 7 status = {}
8112024-09-05T00:45:35.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 57017b8d-5809-4f29-845a-28c63c1c4c84 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8122024-09-05T00:45:35.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 57017b8d-5809-4f29-845a-28c63c1c4c84 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8132024-09-05T00:45:35.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 57017b8d-5809-4f29-845a-28c63c1c4c84 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8142024-09-05T00:45:36.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 295d138e-7959-42ae-85d8-a9b927e18171 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8152024-09-05T00:45:36.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 295d138e-7959-42ae-85d8-a9b927e18171 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8162024-09-05T00:45:36.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 295d138e-7959-42ae-85d8-a9b927e18171 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8172024-09-05T00:45:37.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 885e2e8c-a835-4d9b-a29b-d350e7d1c255 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8182024-09-05T00:45:37.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 885e2e8c-a835-4d9b-a29b-d350e7d1c255 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8192024-09-05T00:45:37.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1805 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 885e2e8c-a835-4d9b-a29b-d350e7d1c255 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8202024-09-05T00:45:38.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 16e86ce6-23a6-46cf-900d-942f568f8629 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8212024-09-05T00:45:38.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 16e86ce6-23a6-46cf-900d-942f568f8629 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8222024-09-05T00:45:38.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 16e86ce6-23a6-46cf-900d-942f568f8629 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8232024-09-05T00:45:39.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a35e0d12-71f7-43d5-938d-70ec8c24735f roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8242024-09-05T00:45:39.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a35e0d12-71f7-43d5-938d-70ec8c24735f resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8252024-09-05T00:45:39.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a35e0d12-71f7-43d5-938d-70ec8c24735f response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8262024-09-05T00:45:40.272ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:61967
8272024-09-05T00:45:40.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61967 req_id = e9281b1a-f71e-44d3-9815-e07e6c4a1eab roles = RoleSet { roles: {} } uri = /metrics/producers
8282024-09-05T00:45:40.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61967 req_id = e9281b1a-f71e-44d3-9815-e07e6c4a1eab resource = Database result = Ok(()) uri = /metrics/producers
8292024-09-05T00:45:40.305ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
8302024-09-05T00:45:40.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61967 req_id = e9281b1a-f71e-44d3-9815-e07e6c4a1eab roles = RoleSet { roles: {} } uri = /metrics/producers
8312024-09-05T00:45:40.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61967 req_id = e9281b1a-f71e-44d3-9815-e07e6c4a1eab resource = Database result = Ok(()) uri = /metrics/producers
8322024-09-05T00:45:40.336ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
8332024-09-05T00:45:40.336ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f5c8f08d-3aed-411b-8294-f75f8c2f7424", "date": "Thu, 05 Sep 2024 00:45:40 GMT"} })
8342024-09-05T00:45:40.336ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = a014d257-275c-449e-a4f4-aef00eab141c
8352024-09-05T00:45:40.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 64527 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61967 req_id = e9281b1a-f71e-44d3-9815-e07e6c4a1eab response_code = 201 uri = /metrics/producers
8362024-09-05T00:45:40.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 59aa7430-a622-48bf-9af3-2fe8e1d89aaf roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8372024-09-05T00:45:40.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 59aa7430-a622-48bf-9af3-2fe8e1d89aaf resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8382024-09-05T00:45:40.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2479 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 59aa7430-a622-48bf-9af3-2fe8e1d89aaf response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8392024-09-05T00:45:41.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5ced2012-04ec-417a-b7d7-7899d4fbaf6e roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8402024-09-05T00:45:41.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5ced2012-04ec-417a-b7d7-7899d4fbaf6e resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8412024-09-05T00:45:41.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1823 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5ced2012-04ec-417a-b7d7-7899d4fbaf6e response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8422024-09-05T00:45:41.582ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:49231
8432024-09-05T00:45:41.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49231 req_id = 6931cebe-ceda-489e-bd71-5a0fef55b71c roles = RoleSet { roles: {} } uri = /metrics/producers
8442024-09-05T00:45:41.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49231 req_id = 6931cebe-ceda-489e-bd71-5a0fef55b71c resource = Database result = Ok(()) uri = /metrics/producers
8452024-09-05T00:45:41.616ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
8462024-09-05T00:45:41.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49231 req_id = 6931cebe-ceda-489e-bd71-5a0fef55b71c roles = RoleSet { roles: {} } uri = /metrics/producers
8472024-09-05T00:45:41.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49231 req_id = 6931cebe-ceda-489e-bd71-5a0fef55b71c resource = Database result = Ok(()) uri = /metrics/producers
8482024-09-05T00:45:41.649ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
8492024-09-05T00:45:41.649ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "308b927a-2ed9-4ba6-90fb-c593ee1ce6ea", "date": "Thu, 05 Sep 2024 00:45:41 GMT"} })
8502024-09-05T00:45:41.649ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = 7133bf3b-5b99-4a6e-bebd-7577dd2d3d94
8512024-09-05T00:45:41.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 68450 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49231 req_id = 6931cebe-ceda-489e-bd71-5a0fef55b71c response_code = 201 uri = /metrics/producers
8522024-09-05T00:45:42.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 47e109bc-2217-490a-a218-ec9abced9a71 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8532024-09-05T00:45:42.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 47e109bc-2217-490a-a218-ec9abced9a71 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8542024-09-05T00:45:42.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 47e109bc-2217-490a-a218-ec9abced9a71 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8552024-09-05T00:45:43.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7f8a0781-cd5f-44ed-899e-4ca7d563df4a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8562024-09-05T00:45:43.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7f8a0781-cd5f-44ed-899e-4ca7d563df4a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8572024-09-05T00:45:43.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7f8a0781-cd5f-44ed-899e-4ca7d563df4a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8582024-09-05T00:45:44.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8a27cb41-cee2-485d-8fbe-7d132895a0e4 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8592024-09-05T00:45:44.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8a27cb41-cee2-485d-8fbe-7d132895a0e4 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8602024-09-05T00:45:44.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8a27cb41-cee2-485d-8fbe-7d132895a0e4 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8612024-09-05T00:45:44.953ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
8622024-09-05T00:45:44.953ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
8632024-09-05T00:45:44.953ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8642024-09-05T00:45:44.953ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8652024-09-05T00:45:44.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8662024-09-05T00:45:44.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8672024-09-05T00:45:44.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8682024-09-05T00:45:44.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8692024-09-05T00:45:44.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8702024-09-05T00:45:44.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8712024-09-05T00:45:44.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8722024-09-05T00:45:44.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8732024-09-05T00:45:44.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8742024-09-05T00:45:44.963ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
8752024-09-05T00:45:44.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8762024-09-05T00:45:44.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8772024-09-05T00:45:44.968ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
8782024-09-05T00:45:44.968ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.873515ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
8792024-09-05T00:45:44.980ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8802024-09-05T00:45:44.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8812024-09-05T00:45:45.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.190856ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8822024-09-05T00:45:45.093ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1477 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 4f0c6d6b-1044-490d-9dc4-cc484746baae response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
8832024-09-05T00:45:45.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 244ed63c-d3dd-4fc6-aec3-9f4bffcaa9f8 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8842024-09-05T00:45:45.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 244ed63c-d3dd-4fc6-aec3-9f4bffcaa9f8 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8852024-09-05T00:45:45.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 244ed63c-d3dd-4fc6-aec3-9f4bffcaa9f8 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8862024-09-05T00:45:46.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5e9a91bb-adb3-4d6f-b05d-c36728c2b8a2 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8872024-09-05T00:45:46.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5e9a91bb-adb3-4d6f-b05d-c36728c2b8a2 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8882024-09-05T00:45:46.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5e9a91bb-adb3-4d6f-b05d-c36728c2b8a2 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8892024-09-05T00:45:47.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 253fc50b-bb41-4214-9a18-97a8db50a5aa roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8902024-09-05T00:45:47.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 253fc50b-bb41-4214-9a18-97a8db50a5aa resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8912024-09-05T00:45:47.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 253fc50b-bb41-4214-9a18-97a8db50a5aa response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8922024-09-05T00:45:48.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4490facb-94de-4f71-a0cb-0d30ef3b3322 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8932024-09-05T00:45:48.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4490facb-94de-4f71-a0cb-0d30ef3b3322 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8942024-09-05T00:45:48.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1773 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4490facb-94de-4f71-a0cb-0d30ef3b3322 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8952024-09-05T00:45:49.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 076a28a5-b2b1-4f4e-af8f-d7b88c36e606 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8962024-09-05T00:45:49.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 076a28a5-b2b1-4f4e-af8f-d7b88c36e606 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8972024-09-05T00:45:49.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1901 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 076a28a5-b2b1-4f4e-af8f-d7b88c36e606 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8982024-09-05T00:45:50.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bf7ed682-73b4-4e1e-beb8-4dc0d023aa5b roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
8992024-09-05T00:45:50.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bf7ed682-73b4-4e1e-beb8-4dc0d023aa5b resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9002024-09-05T00:45:50.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bf7ed682-73b4-4e1e-beb8-4dc0d023aa5b response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9012024-09-05T00:45:51.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 670b04de-fe74-4676-8cd9-9fce69c23ed9 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9022024-09-05T00:45:51.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 670b04de-fe74-4676-8cd9-9fce69c23ed9 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9032024-09-05T00:45:51.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 670b04de-fe74-4676-8cd9-9fce69c23ed9 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9042024-09-05T00:45:52.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 82bbf835-5443-4b0b-89fa-3c7a6fa03c07 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9052024-09-05T00:45:52.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 82bbf835-5443-4b0b-89fa-3c7a6fa03c07 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9062024-09-05T00:45:52.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 82bbf835-5443-4b0b-89fa-3c7a6fa03c07 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9072024-09-05T00:45:53.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5c84c201-8ed7-4b05-b522-c206eecd489d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9082024-09-05T00:45:53.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5c84c201-8ed7-4b05-b522-c206eecd489d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9092024-09-05T00:45:53.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5c84c201-8ed7-4b05-b522-c206eecd489d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9102024-09-05T00:45:54.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1bd95e99-a140-47ee-ae88-f67f3dcd27c5 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9112024-09-05T00:45:54.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1bd95e99-a140-47ee-ae88-f67f3dcd27c5 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9122024-09-05T00:45:54.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2578 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1bd95e99-a140-47ee-ae88-f67f3dcd27c5 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9132024-09-05T00:45:54.954ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
9142024-09-05T00:45:54.954ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
9152024-09-05T00:45:54.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9162024-09-05T00:45:54.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9172024-09-05T00:45:54.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9182024-09-05T00:45:54.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9192024-09-05T00:45:54.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9202024-09-05T00:45:54.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9212024-09-05T00:45:54.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9222024-09-05T00:45:54.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9232024-09-05T00:45:54.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9242024-09-05T00:45:54.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9252024-09-05T00:45:54.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9262024-09-05T00:45:54.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
9272024-09-05T00:45:54.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9282024-09-05T00:45:54.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9292024-09-05T00:45:54.973ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
9302024-09-05T00:45:54.973ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.077649ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
9312024-09-05T00:45:54.979ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9322024-09-05T00:45:54.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9332024-09-05T00:45:55.009ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.770336ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9342024-09-05T00:45:55.093ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1409 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 73e9640a-c6fb-44e2-859d-03ea2ea51d28 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
9352024-09-05T00:45:55.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 87d7b2eb-e31b-4f89-9005-07f58241765f roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9362024-09-05T00:45:55.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 87d7b2eb-e31b-4f89-9005-07f58241765f resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9372024-09-05T00:45:55.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 87d7b2eb-e31b-4f89-9005-07f58241765f response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9382024-09-05T00:45:56.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 89318de2-e3bf-40c6-96fc-9675938693a6 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9392024-09-05T00:45:56.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 89318de2-e3bf-40c6-96fc-9675938693a6 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9402024-09-05T00:45:56.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2660 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 89318de2-e3bf-40c6-96fc-9675938693a6 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9412024-09-05T00:45:57.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b67860cb-01b7-4430-9997-a7e35a0f922e roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9422024-09-05T00:45:57.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b67860cb-01b7-4430-9997-a7e35a0f922e resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9432024-09-05T00:45:57.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b67860cb-01b7-4430-9997-a7e35a0f922e response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9442024-09-05T00:45:58.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 01fdafb2-a196-4ea5-8539-6eb2af4d85b9 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9452024-09-05T00:45:58.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 01fdafb2-a196-4ea5-8539-6eb2af4d85b9 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9462024-09-05T00:45:58.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 01fdafb2-a196-4ea5-8539-6eb2af4d85b9 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9472024-09-05T00:45:59.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a404ff65-49fe-43e5-9bae-9973988ff7fa roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9482024-09-05T00:45:59.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a404ff65-49fe-43e5-9bae-9973988ff7fa resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9492024-09-05T00:45:59.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a404ff65-49fe-43e5-9bae-9973988ff7fa response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9502024-09-05T00:46:00.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8d6c5d7b-02db-4269-8903-4d447c8cec9d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9512024-09-05T00:46:00.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8d6c5d7b-02db-4269-8903-4d447c8cec9d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9522024-09-05T00:46:00.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8d6c5d7b-02db-4269-8903-4d447c8cec9d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9532024-09-05T00:46:01.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 06cff3be-e01a-46a1-a761-5ca050f958d6 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9542024-09-05T00:46:01.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 06cff3be-e01a-46a1-a761-5ca050f958d6 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9552024-09-05T00:46:01.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 06cff3be-e01a-46a1-a761-5ca050f958d6 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9562024-09-05T00:46:02.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b56e5148-0cc1-4ba6-a3e6-b6e5a4541db5 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9572024-09-05T00:46:02.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b56e5148-0cc1-4ba6-a3e6-b6e5a4541db5 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9582024-09-05T00:46:02.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b56e5148-0cc1-4ba6-a3e6-b6e5a4541db5 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9592024-09-05T00:46:03.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a9ad3557-bc5e-418c-bd37-5c6858b7d0bb roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9602024-09-05T00:46:03.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a9ad3557-bc5e-418c-bd37-5c6858b7d0bb resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9612024-09-05T00:46:03.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a9ad3557-bc5e-418c-bd37-5c6858b7d0bb response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
9622024-09-05T00:46:04.952ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
9632024-09-05T00:46:04.952ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
9642024-09-05T00:46:04.952ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9652024-09-05T00:46:04.952ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9662024-09-05T00:46:04.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9672024-09-05T00:46:04.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9682024-09-05T00:46:04.953ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
9692024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
9702024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9712024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
9722024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
9732024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9742024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9752024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9762024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
9772024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
9782024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9792024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
9802024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9812024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
9822024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9832024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9842024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
9852024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9862024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
9872024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9882024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
9892024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9902024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9912024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9922024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9932024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9942024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9952024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9962024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9972024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9982024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9992024-09-05T00:46:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10002024-09-05T00:46:04.955ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3627, tv_nsec: 23338390 } })
10012024-09-05T00:46:04.956ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3627, tv_nsec: 23762557 } })
10022024-09-05T00:46:04.956ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
10032024-09-05T00:46:04.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10042024-09-05T00:46:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10052024-09-05T00:46:04.957ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
10062024-09-05T00:46:04.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10072024-09-05T00:46:04.957ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10082024-09-05T00:46:04.958ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
10092024-09-05T00:46:04.958ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
10102024-09-05T00:46:04.958ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
10112024-09-05T00:46:04.958ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10122024-09-05T00:46:04.958ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
10132024-09-05T00:46:04.958ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10142024-09-05T00:46:04.958ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10152024-09-05T00:46:04.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10162024-09-05T00:46:04.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10172024-09-05T00:46:04.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10182024-09-05T00:46:04.958ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10192024-09-05T00:46:04.958ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.657711ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10202024-09-05T00:46:04.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = b18f7169-d673-4a31-8969-b2c369bdb43e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
10212024-09-05T00:46:04.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = b18f7169-d673-4a31-8969-b2c369bdb43e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
10222024-09-05T00:46:04.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10232024-09-05T00:46:04.960ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10242024-09-05T00:46:04.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10252024-09-05T00:46:04.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10262024-09-05T00:46:04.960ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10272024-09-05T00:46:04.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10282024-09-05T00:46:04.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10292024-09-05T00:46:04.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10302024-09-05T00:46:04.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10312024-09-05T00:46:04.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10322024-09-05T00:46:04.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10332024-09-05T00:46:04.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10342024-09-05T00:46:04.964ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 9.908166ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10352024-09-05T00:46:04.964ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10362024-09-05T00:46:04.964ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10372024-09-05T00:46:04.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10382024-09-05T00:46:04.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10392024-09-05T00:46:04.965ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10402024-09-05T00:46:04.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10412024-09-05T00:46:04.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10422024-09-05T00:46:04.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10432024-09-05T00:46:04.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10442024-09-05T00:46:04.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10452024-09-05T00:46:04.973ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10462024-09-05T00:46:04.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10472024-09-05T00:46:04.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 14238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = b18f7169-d673-4a31-8969-b2c369bdb43e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
10482024-09-05T00:46:04.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10492024-09-05T00:46:04.973ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10502024-09-05T00:46:04.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10512024-09-05T00:46:04.976ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10522024-09-05T00:46:04.976ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3627, tv_nsec: 43635751 } })
10532024-09-05T00:46:04.976ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
10542024-09-05T00:46:04.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10552024-09-05T00:46:04.978ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10562024-09-05T00:46:04.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10572024-09-05T00:46:04.997ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
10582024-09-05T00:46:04.997ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10592024-09-05T00:46:04.997ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10602024-09-05T00:46:04.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10612024-09-05T00:46:04.999ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10622024-09-05T00:46:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10632024-09-05T00:46:05.003ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10642024-09-05T00:46:05.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10652024-09-05T00:46:05.005ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10662024-09-05T00:46:05.006ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10672024-09-05T00:46:05.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10682024-09-05T00:46:05.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a014d257-275c-449e-a4f4-aef00eab141c, lookup_type: ById(a014d257-275c-449e-a4f4-aef00eab141c) } result = Ok(())
10692024-09-05T00:46:05.007ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10702024-09-05T00:46:05.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10712024-09-05T00:46:05.010ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10722024-09-05T00:46:05.010ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 55.951786ms iteration = 8 status = 0
10732024-09-05T00:46:05.010ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10742024-09-05T00:46:05.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10752024-09-05T00:46:05.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10762024-09-05T00:46:05.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10772024-09-05T00:46:05.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10782024-09-05T00:46:05.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 55.103921ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
10792024-09-05T00:46:05.016ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.282248ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
10802024-09-05T00:46:05.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10812024-09-05T00:46:05.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
10822024-09-05T00:46:05.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10832024-09-05T00:46:05.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10842024-09-05T00:46:05.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10852024-09-05T00:46:05.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10862024-09-05T00:46:05.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10872024-09-05T00:46:05.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10882024-09-05T00:46:05.029ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
10892024-09-05T00:46:05.029ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.822502ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
10902024-09-05T00:46:05.032ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
10912024-09-05T00:46:05.032ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
10922024-09-05T00:46:05.032ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 77.946767ms iteration = 8 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
10932024-09-05T00:46:05.038ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10942024-09-05T00:46:05.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10952024-09-05T00:46:05.040ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.348227ms iteration = 8 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
10962024-09-05T00:46:05.048ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10972024-09-05T00:46:05.048ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 93.776399ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10982024-09-05T00:46:05.063ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
10992024-09-05T00:46:05.063ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11002024-09-05T00:46:05.064ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bb8e0dda-13dc-412a-9af6-f4deaada8245", "content-length": "26", "date": "Thu, 05 Sep 2024 00:46:04 GMT"} })
11012024-09-05T00:46:05.064ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11022024-09-05T00:46:05.066ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11032024-09-05T00:46:05.068ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
11042024-09-05T00:46:05.068ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 110.604389ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
11052024-09-05T00:46:05.071ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 116.855481ms iteration = 11 status = {"physical_disks_added":0}
11062024-09-05T00:46:05.094ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = c83ec475-8cf0-4f4d-b830-17ecb3bb1ccb response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
11072024-09-05T00:46:05.098ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
11082024-09-05T00:46:05.098ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11092024-09-05T00:46:05.098ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dbdc317f-79b2-42d3-91cc-e9256e7ee361", "content-length": "26", "date": "Thu, 05 Sep 2024 00:46:04 GMT"} })
11102024-09-05T00:46:05.098ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11112024-09-05T00:46:05.098ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11122024-09-05T00:46:05.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11132024-09-05T00:46:05.099ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11142024-09-05T00:46:05.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 68874762-1d11-4649-98f9-d818cd11c009 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
11152024-09-05T00:46:05.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 68874762-1d11-4649-98f9-d818cd11c009 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
11162024-09-05T00:46:05.129ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11172024-09-05T00:46:05.131ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11182024-09-05T00:46:05.131ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11192024-09-05T00:46:05.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11202024-09-05T00:46:05.148ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b zone_address = fd00:1122:3344:101::2
11212024-09-05T00:46:05.148ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11222024-09-05T00:46:05.148ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2adb0365-d551-4726-954e-63bbf988d789", "content-length": "26", "date": "Thu, 05 Sep 2024 00:46:04 GMT"} })
11232024-09-05T00:46:05.148ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11242024-09-05T00:46:05.149ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
11252024-09-05T00:46:05.199ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11262024-09-05T00:46:05.199ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d4bde395-bc70-4897-9a39-27f47600ac84", "content-length": "372", "date": "Thu, 05 Sep 2024 00:46:05 GMT"} })
11272024-09-05T00:46:05.199ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11282024-09-05T00:46:05.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11292024-09-05T00:46:05.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11302024-09-05T00:46:05.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 86740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 68874762-1d11-4649-98f9-d818cd11c009 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
11312024-09-05T00:46:05.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11322024-09-05T00:46:05.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11332024-09-05T00:46:05.202ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11342024-09-05T00:46:05.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11352024-09-05T00:46:05.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11362024-09-05T00:46:05.204ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 251.612949ms iteration = 8 status = {}
11372024-09-05T00:46:05.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11382024-09-05T00:46:05.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11392024-09-05T00:46:05.206ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11402024-09-05T00:46:05.206ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "26012b97-01d4-4e94-a804-0da010d80fd0", "content-length": "1", "date": "Thu, 05 Sep 2024 00:46:04 GMT"} })
11412024-09-05T00:46:05.209ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11422024-09-05T00:46:05.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11432024-09-05T00:46:05.209ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11442024-09-05T00:46:05.210ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a40d075c-0111-455f-8a70-62b3f13930e6", "date": "Thu, 05 Sep 2024 00:46:05 GMT"} })
11452024-09-05T00:46:05.210ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 257.770849ms iteration = 8 status = null
11462024-09-05T00:46:05.211ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 256.840272ms iteration = 9 status = {}
11472024-09-05T00:46:05.326ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11482024-09-05T00:46:05.327ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e37576ef-8c4f-4e75-82b9-2178c6c883cc", "content-length": "691", "date": "Thu, 05 Sep 2024 00:46:05 GMT"} })
11492024-09-05T00:46:05.327ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
11502024-09-05T00:46:05.327ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
11512024-09-05T00:46:05.327ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
11522024-09-05T00:46:05.328ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 374.023878ms iteration = 8 status = {}
11532024-09-05T00:46:05.386ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11542024-09-05T00:46:05.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11552024-09-05T00:46:05.389ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 3013d0b1-47fb-4df1-97e5-7049d1043033, rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c4762fe-488f-4054-979a-f54d371ea654) } rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
11562024-09-05T00:46:05.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11572024-09-05T00:46:05.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11582024-09-05T00:46:05.399ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11592024-09-05T00:46:05.400ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e46c2d74-b165-4b94-8d34-89f66af0f3db", "content-length": "121", "date": "Thu, 05 Sep 2024 00:46:04 GMT"} })
11602024-09-05T00:46:05.400ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
11612024-09-05T00:46:05.400ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c4762fe-488f-4054-979a-f54d371ea654
11622024-09-05T00:46:05.400ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11632024-09-05T00:46:05.400ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11642024-09-05T00:46:05.400ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
11652024-09-05T00:46:05.400ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
11662024-09-05T00:46:05.400ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
11672024-09-05T00:46:05.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11682024-09-05T00:46:05.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11692024-09-05T00:46:05.402ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11702024-09-05T00:46:05.403ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5ce21cd0-5a92-4a27-a65e-3e3edc6608c2", "content-length": "2", "date": "Thu, 05 Sep 2024 00:46:04 GMT"} })
11712024-09-05T00:46:05.403ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11722024-09-05T00:46:05.403ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "09f35934-843c-42db-8dc8-08ec5bc6c9e1", "content-length": "51", "date": "Thu, 05 Sep 2024 00:46:04 GMT"} })
11732024-09-05T00:46:05.403ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
11742024-09-05T00:46:05.403ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11752024-09-05T00:46:05.499ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3a83d84c-da24-40fa-8914-2708b817bc19", "date": "Thu, 05 Sep 2024 00:46:05 GMT"} })
11762024-09-05T00:46:05.499ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch = Switch0
11772024-09-05T00:46:05.499ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11782024-09-05T00:46:05.499ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "70df60e0-cda7-4565-8914-ec11a4784118", "content-length": "667", "date": "Thu, 05 Sep 2024 00:46:05 GMT"} })
11792024-09-05T00:46:05.499ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11802024-09-05T00:46:05.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11812024-09-05T00:46:05.503ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11822024-09-05T00:46:05.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11832024-09-05T00:46:05.506ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11842024-09-05T00:46:05.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11852024-09-05T00:46:05.508ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11862024-09-05T00:46:05.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11872024-09-05T00:46:05.515ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 560.896295ms iteration = 8 status = {}
11882024-09-05T00:46:06.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9cd3b613-b1d4-4702-94a9-8abf97f20f34 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
11892024-09-05T00:46:06.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9cd3b613-b1d4-4702-94a9-8abf97f20f34 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
11902024-09-05T00:46:06.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9cd3b613-b1d4-4702-94a9-8abf97f20f34 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
11912024-09-05T00:46:07.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 24360305-dd08-44f6-8dbd-79e8fd4f6699 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
11922024-09-05T00:46:07.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 24360305-dd08-44f6-8dbd-79e8fd4f6699 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
11932024-09-05T00:46:07.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 24360305-dd08-44f6-8dbd-79e8fd4f6699 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
11942024-09-05T00:46:08.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e46ed3d3-97fa-4e37-8121-443873b2cf00 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
11952024-09-05T00:46:08.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e46ed3d3-97fa-4e37-8121-443873b2cf00 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
11962024-09-05T00:46:08.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2849 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e46ed3d3-97fa-4e37-8121-443873b2cf00 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
11972024-09-05T00:46:09.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 843283df-5382-4d08-a549-f51eebb08913 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
11982024-09-05T00:46:09.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 843283df-5382-4d08-a549-f51eebb08913 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
11992024-09-05T00:46:09.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 843283df-5382-4d08-a549-f51eebb08913 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12002024-09-05T00:46:10.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4b5f0f38-3dac-44b6-8bc2-e80b653b03d7 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12012024-09-05T00:46:10.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4b5f0f38-3dac-44b6-8bc2-e80b653b03d7 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12022024-09-05T00:46:10.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4b5f0f38-3dac-44b6-8bc2-e80b653b03d7 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12032024-09-05T00:46:11.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ea3de585-614f-4905-a95f-291f835bfa5d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12042024-09-05T00:46:11.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ea3de585-614f-4905-a95f-291f835bfa5d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12052024-09-05T00:46:11.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ea3de585-614f-4905-a95f-291f835bfa5d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12062024-09-05T00:46:12.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 45eb5cc0-9807-4dbe-bd5f-e41fa4fe3761 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12072024-09-05T00:46:12.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 45eb5cc0-9807-4dbe-bd5f-e41fa4fe3761 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12082024-09-05T00:46:12.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2678 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 45eb5cc0-9807-4dbe-bd5f-e41fa4fe3761 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12092024-09-05T00:46:13.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6c69c1d3-eb90-42b0-a0c2-95e9d0477b0b roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12102024-09-05T00:46:13.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6c69c1d3-eb90-42b0-a0c2-95e9d0477b0b resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12112024-09-05T00:46:13.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6c69c1d3-eb90-42b0-a0c2-95e9d0477b0b response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12122024-09-05T00:46:14.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7d36cc2e-22c5-4414-a621-a532029139b3 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12132024-09-05T00:46:14.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7d36cc2e-22c5-4414-a621-a532029139b3 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12142024-09-05T00:46:14.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7d36cc2e-22c5-4414-a621-a532029139b3 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12152024-09-05T00:46:14.954ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
12162024-09-05T00:46:14.954ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
12172024-09-05T00:46:14.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12182024-09-05T00:46:14.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12192024-09-05T00:46:14.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12202024-09-05T00:46:14.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12212024-09-05T00:46:14.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12222024-09-05T00:46:14.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12232024-09-05T00:46:14.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12242024-09-05T00:46:14.957ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.813048ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12252024-09-05T00:46:14.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12262024-09-05T00:46:14.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12272024-09-05T00:46:14.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12282024-09-05T00:46:14.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12292024-09-05T00:46:14.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12302024-09-05T00:46:14.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12312024-09-05T00:46:14.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
12322024-09-05T00:46:14.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12332024-09-05T00:46:14.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12342024-09-05T00:46:14.971ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
12352024-09-05T00:46:14.971ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.878829ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
12362024-09-05T00:46:15.093ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1438 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = f35180c8-4958-4c1d-92cf-a7635a610bd7 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
12372024-09-05T00:46:15.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6ba763fa-3eae-452c-8f55-71f485e02f98 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12382024-09-05T00:46:15.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6ba763fa-3eae-452c-8f55-71f485e02f98 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12392024-09-05T00:46:15.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6ba763fa-3eae-452c-8f55-71f485e02f98 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12402024-09-05T00:46:16.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e1f1f776-d6ec-44c4-8faa-ac3ab08dcbba roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12412024-09-05T00:46:16.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e1f1f776-d6ec-44c4-8faa-ac3ab08dcbba resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12422024-09-05T00:46:16.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e1f1f776-d6ec-44c4-8faa-ac3ab08dcbba response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12432024-09-05T00:46:17.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 871a98e9-ea77-4d05-ba21-24c2264a8002 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12442024-09-05T00:46:17.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 871a98e9-ea77-4d05-ba21-24c2264a8002 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12452024-09-05T00:46:17.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 871a98e9-ea77-4d05-ba21-24c2264a8002 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12462024-09-05T00:46:18.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 94fe5925-e409-417d-bae2-717829065842 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12472024-09-05T00:46:18.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 94fe5925-e409-417d-bae2-717829065842 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12482024-09-05T00:46:18.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 94fe5925-e409-417d-bae2-717829065842 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12492024-09-05T00:46:19.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 60c501f9-5813-4de8-a455-1dc9fe118f58 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12502024-09-05T00:46:19.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 60c501f9-5813-4de8-a455-1dc9fe118f58 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12512024-09-05T00:46:19.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 60c501f9-5813-4de8-a455-1dc9fe118f58 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12522024-09-05T00:46:20.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fcc55961-5b00-4497-bcaf-83adb2cc5755 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12532024-09-05T00:46:20.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fcc55961-5b00-4497-bcaf-83adb2cc5755 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12542024-09-05T00:46:20.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fcc55961-5b00-4497-bcaf-83adb2cc5755 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12552024-09-05T00:46:21.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e2bbd7dd-2b89-4fe2-be79-0e93e343e264 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12562024-09-05T00:46:21.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e2bbd7dd-2b89-4fe2-be79-0e93e343e264 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12572024-09-05T00:46:21.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e2bbd7dd-2b89-4fe2-be79-0e93e343e264 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12582024-09-05T00:46:22.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1a34597e-1fab-4513-afe6-e228279a7d2f roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12592024-09-05T00:46:22.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1a34597e-1fab-4513-afe6-e228279a7d2f resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12602024-09-05T00:46:22.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1a34597e-1fab-4513-afe6-e228279a7d2f response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12612024-09-05T00:46:23.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5b78ed97-d6d3-48f5-b388-7d610daa706a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12622024-09-05T00:46:23.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5b78ed97-d6d3-48f5-b388-7d610daa706a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12632024-09-05T00:46:23.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2652 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5b78ed97-d6d3-48f5-b388-7d610daa706a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12642024-09-05T00:46:24.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 455c852b-8851-400a-9fba-7f509ba46227 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12652024-09-05T00:46:24.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 455c852b-8851-400a-9fba-7f509ba46227 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12662024-09-05T00:46:24.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 455c852b-8851-400a-9fba-7f509ba46227 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12672024-09-05T00:46:24.954ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
12682024-09-05T00:46:24.954ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
12692024-09-05T00:46:24.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12702024-09-05T00:46:24.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12712024-09-05T00:46:24.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12722024-09-05T00:46:24.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12732024-09-05T00:46:24.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12742024-09-05T00:46:24.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12752024-09-05T00:46:24.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12762024-09-05T00:46:24.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12772024-09-05T00:46:24.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12782024-09-05T00:46:24.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12792024-09-05T00:46:24.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12802024-09-05T00:46:24.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12812024-09-05T00:46:24.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12822024-09-05T00:46:24.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
12832024-09-05T00:46:24.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12842024-09-05T00:46:24.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12852024-09-05T00:46:24.973ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
12862024-09-05T00:46:24.973ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.172271ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
12872024-09-05T00:46:24.983ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.870364ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12882024-09-05T00:46:25.093ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1482 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = b434d6b6-b1be-4864-a83a-11437f26ff7b response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
12892024-09-05T00:46:25.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f57b4f20-763c-4e02-a7af-8b6700869a55 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12902024-09-05T00:46:25.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f57b4f20-763c-4e02-a7af-8b6700869a55 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12912024-09-05T00:46:25.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f57b4f20-763c-4e02-a7af-8b6700869a55 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12922024-09-05T00:46:26.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 98edae1e-453e-4392-b97f-8daceec39835 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12932024-09-05T00:46:26.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 98edae1e-453e-4392-b97f-8daceec39835 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12942024-09-05T00:46:26.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 98edae1e-453e-4392-b97f-8daceec39835 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12952024-09-05T00:46:27.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = abd7468c-944a-470a-bf20-b69f64402b6f roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12962024-09-05T00:46:27.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = abd7468c-944a-470a-bf20-b69f64402b6f resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12972024-09-05T00:46:27.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = abd7468c-944a-470a-bf20-b69f64402b6f response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12982024-09-05T00:46:28.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ca82919a-c15d-4f97-9464-e086d7ef90da roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
12992024-09-05T00:46:28.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ca82919a-c15d-4f97-9464-e086d7ef90da resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13002024-09-05T00:46:28.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ca82919a-c15d-4f97-9464-e086d7ef90da response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13012024-09-05T00:46:29.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4fa59f10-09ab-4f41-be0b-5aa267596446 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13022024-09-05T00:46:29.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4fa59f10-09ab-4f41-be0b-5aa267596446 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13032024-09-05T00:46:29.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4fa59f10-09ab-4f41-be0b-5aa267596446 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13042024-09-05T00:46:30.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 896319fc-5628-4001-804b-f6cca7c2284a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13052024-09-05T00:46:30.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 896319fc-5628-4001-804b-f6cca7c2284a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13062024-09-05T00:46:30.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 896319fc-5628-4001-804b-f6cca7c2284a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13072024-09-05T00:46:31.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f74c8edd-b5d0-4bc7-b113-f6e71ee41b4f roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13082024-09-05T00:46:31.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f74c8edd-b5d0-4bc7-b113-f6e71ee41b4f resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13092024-09-05T00:46:31.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1894 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f74c8edd-b5d0-4bc7-b113-f6e71ee41b4f response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13102024-09-05T00:46:32.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 80bf9cdf-2dcc-42ee-9980-42be23177015 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13112024-09-05T00:46:32.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 80bf9cdf-2dcc-42ee-9980-42be23177015 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13122024-09-05T00:46:32.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 80bf9cdf-2dcc-42ee-9980-42be23177015 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13132024-09-05T00:46:33.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 99be7473-1fe5-4900-bfbf-734e6e76ad8a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13142024-09-05T00:46:33.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 99be7473-1fe5-4900-bfbf-734e6e76ad8a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13152024-09-05T00:46:33.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 99be7473-1fe5-4900-bfbf-734e6e76ad8a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13162024-09-05T00:46:34.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 30f5220f-7ad3-43e2-81e1-491f97719433 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13172024-09-05T00:46:34.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 30f5220f-7ad3-43e2-81e1-491f97719433 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13182024-09-05T00:46:34.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 30f5220f-7ad3-43e2-81e1-491f97719433 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
13192024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
13202024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
13212024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13222024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13232024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
13242024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
13252024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
13262024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13272024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13282024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
13292024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
13302024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
13312024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
13322024-09-05T00:46:34.952ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-05 00:36:34.952547639 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13332024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13342024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13352024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
13362024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13372024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13382024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13392024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13402024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13412024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13422024-09-05T00:46:34.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13432024-09-05T00:46:34.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
13442024-09-05T00:46:34.953ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
13452024-09-05T00:46:34.953ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("145d6d08-bb1c-4557-af3d-b3b8e647b114.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4aa18504-a7e8-4aa1-94fe-a65abab62a4b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("4aa18504-a7e8-4aa1-94fe-a65abab62a4b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3657, tv_nsec: 20396815 } })
13462024-09-05T00:46:34.953ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c51ae87-cbaf-4403-8e7a-91ae1f6a480f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89145bfe-85a8-47ae-9826-e73f4757fe92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("972980d1-78ce-4b3e-8b23-36e1a0e30ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("972980d1-78ce-4b3e-8b23-36e1a0e30ffb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 3657, tv_nsec: 20396995 } })
13472024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
13482024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
13492024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13502024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
13512024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13522024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13532024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
13542024-09-05T00:46:34.954ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
13552024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
13562024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13572024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13582024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
13592024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13602024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
13612024-09-05T00:46:34.954ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59
13622024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
13632024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.13\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59"}
13642024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
13652024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
13662024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13672024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13682024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13692024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
13702024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13712024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13722024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
13732024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13742024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13752024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13762024-09-05T00:46:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13772024-09-05T00:46:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13782024-09-05T00:46:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13792024-09-05T00:46:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13802024-09-05T00:46:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13812024-09-05T00:46:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
13822024-09-05T00:46:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13832024-09-05T00:46:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13842024-09-05T00:46:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13852024-09-05T00:46:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13862024-09-05T00:46:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13872024-09-05T00:46:34.955ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13882024-09-05T00:46:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13892024-09-05T00:46:34.956ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
13902024-09-05T00:46:34.956ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.96703ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
13912024-09-05T00:46:34.958ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
13922024-09-05T00:46:34.958ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13932024-09-05T00:46:34.958ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-05 00:36:34.952547639 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
13942024-09-05T00:46:34.958ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
13952024-09-05T00:46:34.958ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
13962024-09-05T00:46:34.958ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.824194ms iteration = 5 status = {"expiration":"2024-09-05T00:36:34.952547639Z","pruned":[]}
13972024-09-05T00:46:34.958ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
13982024-09-05T00:46:34.958ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
13992024-09-05T00:46:34.958ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
14002024-09-05T00:46:34.958ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
14012024-09-05T00:46:34.958ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
14022024-09-05T00:46:34.958ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
14032024-09-05T00:46:34.958ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
14042024-09-05T00:46:34.958ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14052024-09-05T00:46:34.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
14062024-09-05T00:46:34.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14072024-09-05T00:46:34.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14082024-09-05T00:46:34.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14092024-09-05T00:46:34.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14102024-09-05T00:46:34.959ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
14112024-09-05T00:46:34.959ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 7.363651ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
14122024-09-05T00:46:34.959ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3657, tv_nsec: 26988123 } })
14132024-09-05T00:46:34.959ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3657, tv_nsec: 27009963 } })
14142024-09-05T00:46:34.961ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
14152024-09-05T00:46:34.962ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
14162024-09-05T00:46:34.964ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14172024-09-05T00:46:34.965ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14182024-09-05T00:46:34.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14192024-09-05T00:46:34.965ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 12.540323ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14202024-09-05T00:46:34.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14212024-09-05T00:46:34.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14222024-09-05T00:46:34.967ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14232024-09-05T00:46:34.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14242024-09-05T00:46:34.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14252024-09-05T00:46:34.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14262024-09-05T00:46:34.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14272024-09-05T00:46:34.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14282024-09-05T00:46:34.975ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14292024-09-05T00:46:34.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14302024-09-05T00:46:34.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14312024-09-05T00:46:34.976ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14322024-09-05T00:46:34.978ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14332024-09-05T00:46:34.979ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14342024-09-05T00:46:34.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14352024-09-05T00:46:34.979ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14362024-09-05T00:46:34.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14372024-09-05T00:46:34.980ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.742517ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
14382024-09-05T00:46:34.982ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14392024-09-05T00:46:34.982ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14402024-09-05T00:46:34.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14412024-09-05T00:46:34.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14422024-09-05T00:46:34.984ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 26.250837ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
14432024-09-05T00:46:34.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14442024-09-05T00:46:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14452024-09-05T00:46:34.992ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14462024-09-05T00:46:34.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14472024-09-05T00:46:34.995ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14482024-09-05T00:46:34.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14492024-09-05T00:46:34.998ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14502024-09-05T00:46:35.000ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14512024-09-05T00:46:35.000ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14522024-09-05T00:46:35.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14532024-09-05T00:46:35.002ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14542024-09-05T00:46:35.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14552024-09-05T00:46:35.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 3060b46e-24ed-47a1-8981-a88af5a35c7b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
14562024-09-05T00:46:35.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 3060b46e-24ed-47a1-8981-a88af5a35c7b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
14572024-09-05T00:46:35.005ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14582024-09-05T00:46:35.005ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14592024-09-05T00:46:35.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14602024-09-05T00:46:35.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
14612024-09-05T00:46:35.009ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14622024-09-05T00:46:35.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14632024-09-05T00:46:35.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14642024-09-05T00:46:35.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14652024-09-05T00:46:35.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14662024-09-05T00:46:35.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14672024-09-05T00:46:35.017ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14682024-09-05T00:46:35.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 15726 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 3060b46e-24ed-47a1-8981-a88af5a35c7b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
14692024-09-05T00:46:35.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
14702024-09-05T00:46:35.019ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14712024-09-05T00:46:35.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14722024-09-05T00:46:35.028ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3657, tv_nsec: 95529633 } })
14732024-09-05T00:46:35.028ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
14742024-09-05T00:46:35.029ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
14752024-09-05T00:46:35.029ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14762024-09-05T00:46:35.029ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14772024-09-05T00:46:35.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14782024-09-05T00:46:35.030ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14792024-09-05T00:46:35.030ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14802024-09-05T00:46:35.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14812024-09-05T00:46:35.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14822024-09-05T00:46:35.032ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14832024-09-05T00:46:35.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14842024-09-05T00:46:35.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14852024-09-05T00:46:35.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14862024-09-05T00:46:35.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14872024-09-05T00:46:35.038ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
14882024-09-05T00:46:35.038ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
14892024-09-05T00:46:35.038ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
14902024-09-05T00:46:35.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14912024-09-05T00:46:35.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14922024-09-05T00:46:35.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14932024-09-05T00:46:35.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14942024-09-05T00:46:35.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14952024-09-05T00:46:35.041ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.777885ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14962024-09-05T00:46:35.042ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
14972024-09-05T00:46:35.042ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
14982024-09-05T00:46:35.042ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
14992024-09-05T00:46:35.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15002024-09-05T00:46:35.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15012024-09-05T00:46:35.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15022024-09-05T00:46:35.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15032024-09-05T00:46:35.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
15042024-09-05T00:46:35.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15052024-09-05T00:46:35.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15062024-09-05T00:46:35.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15072024-09-05T00:46:35.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15082024-09-05T00:46:35.046ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15092024-09-05T00:46:35.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15102024-09-05T00:46:35.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15112024-09-05T00:46:35.050ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
15122024-09-05T00:46:35.050ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
15132024-09-05T00:46:35.050ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 92.246003ms iteration = 5 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
15142024-09-05T00:46:35.055ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15152024-09-05T00:46:35.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15162024-09-05T00:46:35.057ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15172024-09-05T00:46:35.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15182024-09-05T00:46:35.058ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15192024-09-05T00:46:35.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15202024-09-05T00:46:35.060ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15212024-09-05T00:46:35.061ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
15222024-09-05T00:46:35.061ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 107.32761ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
15232024-09-05T00:46:35.062ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15242024-09-05T00:46:35.062ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15252024-09-05T00:46:35.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15262024-09-05T00:46:35.062ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 108.017203ms iteration = 9 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
15272024-09-05T00:46:35.064ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 110.10805ms iteration = 12 status = {"physical_disks_added":0}
15282024-09-05T00:46:35.071ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
15292024-09-05T00:46:35.071ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15302024-09-05T00:46:35.071ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 116.333691ms iteration = 9 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
15312024-09-05T00:46:35.073ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
15322024-09-05T00:46:35.073ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
15332024-09-05T00:46:35.073ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 118.961768ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15342024-09-05T00:46:35.078ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.306981ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
15352024-09-05T00:46:35.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15362024-09-05T00:46:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15372024-09-05T00:46:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15382024-09-05T00:46:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a014d257-275c-449e-a4f4-aef00eab141c, lookup_type: ById(a014d257-275c-449e-a4f4-aef00eab141c) } result = Ok(())
15392024-09-05T00:46:35.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15402024-09-05T00:46:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15412024-09-05T00:46:35.089ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
15422024-09-05T00:46:35.089ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15432024-09-05T00:46:35.090ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 135.498541ms iteration = 9 status = 0
15442024-09-05T00:46:35.090ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8883836c-7b6d-4d23-937c-2e9cf9a43745", "content-length": "26", "date": "Thu, 05 Sep 2024 00:46:34 GMT"} })
15452024-09-05T00:46:35.090ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15462024-09-05T00:46:35.090ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
15472024-09-05T00:46:35.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15482024-09-05T00:46:35.091ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
15492024-09-05T00:46:35.091ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 32541e10-8a85-4410-9858-67a9ab52251d dns_zone_name = oxide.test found_so_far = 0 version = 2
15502024-09-05T00:46:35.091ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15512024-09-05T00:46:35.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15522024-09-05T00:46:35.092ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15532024-09-05T00:46:35.093ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15542024-09-05T00:46:35.093ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1379 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = acc8d091-3bb0-4af7-adc7-7290213d066e response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
15552024-09-05T00:46:35.094ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15562024-09-05T00:46:35.094ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 139.524683ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15572024-09-05T00:46:35.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15582024-09-05T00:46:35.094ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15592024-09-05T00:46:35.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15602024-09-05T00:46:35.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15612024-09-05T00:46:35.095ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15622024-09-05T00:46:35.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15632024-09-05T00:46:35.097ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
15642024-09-05T00:46:35.097ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15652024-09-05T00:46:35.097ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "68727ef2-91d8-48c5-bbb5-a03039f8afd5", "content-length": "26", "date": "Thu, 05 Sep 2024 00:46:34 GMT"} })
15662024-09-05T00:46:35.097ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15672024-09-05T00:46:35.097ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
15682024-09-05T00:46:35.097ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 59a6be26-b8fa-4e7a-8244-7a4e92426c26 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
15692024-09-05T00:46:35.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15702024-09-05T00:46:35.098ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 32541e10-8a85-4410-9858-67a9ab52251d dns_zone_name = oxide.test found_so_far = 1 version = 2
15712024-09-05T00:46:35.098ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
15722024-09-05T00:46:35.098ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-05 00:42:43.837540 UTC dns_group = external generation = 2
15732024-09-05T00:46:35.098ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 145.443628ms iteration = 6 status = {"generation":2}
15742024-09-05T00:46:35.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15752024-09-05T00:46:35.099ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15762024-09-05T00:46:35.100ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
15772024-09-05T00:46:35.101ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-05T00:42:33.143008Z, time_modified: 2024-09-05T00:42:33.143008Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2d4fccaa-0031-45b8-a053-9531608bab06, db_silo: Silo { identity: SiloIdentity { id: 2d4fccaa-0031-45b8-a053-9531608bab06, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-05T00:42:43.791199Z, time_modified: 2024-09-05T00:42:43.791199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2d4fccaa-0031-45b8-a053-9531608bab06, db_silo: Silo { identity: SiloIdentity { id: 2d4fccaa-0031-45b8-a053-9531608bab06, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-05T00:42:43.791199Z, time_modified: 2024-09-05T00:42:43.791199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017" }] }) }
15782024-09-05T00:46:35.101ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 148.605575ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2d4fccaa-0031-45b8-a053-9531608bab06","tls_certs":["a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017"]}},"default_endpoint":{"silo_id":"2d4fccaa-0031-45b8-a053-9531608bab06","tls_certs":["a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
15792024-09-05T00:46:35.108ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15802024-09-05T00:46:35.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15812024-09-05T00:46:35.111ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15822024-09-05T00:46:35.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15832024-09-05T00:46:35.114ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 59a6be26-b8fa-4e7a-8244-7a4e92426c26 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
15842024-09-05T00:46:35.114ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
15852024-09-05T00:46:35.114ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15862024-09-05T00:46:35.114ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-05 00:42:43.011780 UTC dns_group = internal generation = 1
15872024-09-05T00:46:35.114ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 161.919752ms iteration = 6 status = {"generation":1}
15882024-09-05T00:46:35.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15892024-09-05T00:46:35.122ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
15902024-09-05T00:46:35.122ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 164.547639ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
15912024-09-05T00:46:35.173ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b zone_address = fd00:1122:3344:101::2
15922024-09-05T00:46:35.173ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15932024-09-05T00:46:35.174ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3ed47d4a-76a9-4659-ba15-b4e7101cbce3", "content-length": "26", "date": "Thu, 05 Sep 2024 00:46:34 GMT"} })
15942024-09-05T00:46:35.174ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15952024-09-05T00:46:35.175ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
15962024-09-05T00:46:35.209ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15972024-09-05T00:46:35.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15982024-09-05T00:46:35.254ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
15992024-09-05T00:46:35.254ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b19b7091-e2e5-42b8-a131-13f41ffd79f8", "content-length": "1", "date": "Thu, 05 Sep 2024 00:46:34 GMT"} })
16002024-09-05T00:46:35.256ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16012024-09-05T00:46:35.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16022024-09-05T00:46:35.259ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16032024-09-05T00:46:35.410ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
16042024-09-05T00:46:35.411ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fbea45f0-1bf5-4d67-970a-1eda536d1742", "date": "Thu, 05 Sep 2024 00:46:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16052024-09-05T00:46:35.411ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16062024-09-05T00:46:35.413ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "52b8ffad-3941-4379-bbb4-1a45be54909b", "date": "Thu, 05 Sep 2024 00:46:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16072024-09-05T00:46:35.413ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16082024-09-05T00:46:35.414ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "91f0a2b3-b568-4109-b368-a1a8d34596af", "date": "Thu, 05 Sep 2024 00:46:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16092024-09-05T00:46:35.414ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16102024-09-05T00:46:35.416ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
16112024-09-05T00:46:35.416ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 464.341086ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16122024-09-05T00:46:35.481ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 528.653041ms iteration = 9 status = {}
16132024-09-05T00:46:35.483ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
16142024-09-05T00:46:35.484ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3896e5bc-d8c5-47c6-9987-fc91c0e1697a", "date": "Thu, 05 Sep 2024 00:46:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16152024-09-05T00:46:35.484ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16162024-09-05T00:46:35.485ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f190438f-7be7-4003-91d2-d80e2f8e2efb", "date": "Thu, 05 Sep 2024 00:46:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16172024-09-05T00:46:35.485ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16182024-09-05T00:46:35.487ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16192024-09-05T00:46:35.487ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5495c0f6-df5d-423f-843f-ebcdd5d735c2", "content-length": "372", "date": "Thu, 05 Sep 2024 00:46:35 GMT"} })
16202024-09-05T00:46:35.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16212024-09-05T00:46:35.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16222024-09-05T00:46:35.488ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16232024-09-05T00:46:35.488ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 535.820508ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16242024-09-05T00:46:35.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16252024-09-05T00:46:35.489ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 536.96757ms iteration = 9 status = null
16262024-09-05T00:46:35.490ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16272024-09-05T00:46:35.490ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16282024-09-05T00:46:35.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16292024-09-05T00:46:35.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16302024-09-05T00:46:35.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16312024-09-05T00:46:35.491ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16322024-09-05T00:46:35.493ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16332024-09-05T00:46:35.493ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16342024-09-05T00:46:35.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16352024-09-05T00:46:35.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16362024-09-05T00:46:35.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16372024-09-05T00:46:35.496ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16382024-09-05T00:46:35.496ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a384d8be-2bf7-4665-9156-e2dcf0e98f6e", "date": "Thu, 05 Sep 2024 00:46:35 GMT"} })
16392024-09-05T00:46:35.498ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 543.905873ms iteration = 10 status = {}
16402024-09-05T00:46:35.528ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16412024-09-05T00:46:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16422024-09-05T00:46:35.530ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 3013d0b1-47fb-4df1-97e5-7049d1043033, rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c4762fe-488f-4054-979a-f54d371ea654) } rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
16432024-09-05T00:46:35.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16442024-09-05T00:46:35.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16452024-09-05T00:46:35.538ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16462024-09-05T00:46:35.539ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0e870723-3117-4fc1-a838-20b36b9fe0e9", "content-length": "121", "date": "Thu, 05 Sep 2024 00:46:34 GMT"} })
16472024-09-05T00:46:35.539ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
16482024-09-05T00:46:35.539ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c4762fe-488f-4054-979a-f54d371ea654
16492024-09-05T00:46:35.539ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16502024-09-05T00:46:35.539ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16512024-09-05T00:46:35.539ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
16522024-09-05T00:46:35.539ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
16532024-09-05T00:46:35.539ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
16542024-09-05T00:46:35.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16552024-09-05T00:46:35.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16562024-09-05T00:46:35.541ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16572024-09-05T00:46:35.542ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "409a04d7-586e-44b6-9de2-e5f5d6d453a8", "content-length": "691", "date": "Thu, 05 Sep 2024 00:46:35 GMT"} })
16582024-09-05T00:46:35.542ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
16592024-09-05T00:46:35.542ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
16602024-09-05T00:46:35.542ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
16612024-09-05T00:46:35.543ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16622024-09-05T00:46:35.543ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3e65569b-f032-4fcf-b3e1-57132290aa66", "content-length": "2", "date": "Thu, 05 Sep 2024 00:46:34 GMT"} })
16632024-09-05T00:46:35.543ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16642024-09-05T00:46:35.543ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f993b0b7-38e2-44b6-88e4-c36a91b4f9ff", "content-length": "51", "date": "Thu, 05 Sep 2024 00:46:34 GMT"} })
16652024-09-05T00:46:35.543ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
16662024-09-05T00:46:35.543ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16672024-09-05T00:46:35.543ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 588.71672ms iteration = 9 status = {}
16682024-09-05T00:46:35.635ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "04d22f6e-9daa-4023-95e9-cf23ddfd90f0", "date": "Thu, 05 Sep 2024 00:46:35 GMT"} })
16692024-09-05T00:46:35.635ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch = Switch0
16702024-09-05T00:46:35.635ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16712024-09-05T00:46:35.635ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3f8990fa-d0b8-4f95-9db1-86aa8eec7afc", "content-length": "667", "date": "Thu, 05 Sep 2024 00:46:35 GMT"} })
16722024-09-05T00:46:35.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16732024-09-05T00:46:35.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16742024-09-05T00:46:35.639ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16752024-09-05T00:46:35.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16762024-09-05T00:46:35.643ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16772024-09-05T00:46:35.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16782024-09-05T00:46:35.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16792024-09-05T00:46:35.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16802024-09-05T00:46:35.653ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 698.905442ms iteration = 9 status = {}
16812024-09-05T00:46:35.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4ad9b2fb-47ff-414a-89dc-d2dfed5529b9 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16822024-09-05T00:46:35.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4ad9b2fb-47ff-414a-89dc-d2dfed5529b9 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16832024-09-05T00:46:35.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4ad9b2fb-47ff-414a-89dc-d2dfed5529b9 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16842024-09-05T00:46:36.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 05d6686f-6efd-4727-9e59-794b2b941d83 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16852024-09-05T00:46:36.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 05d6686f-6efd-4727-9e59-794b2b941d83 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16862024-09-05T00:46:36.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 05d6686f-6efd-4727-9e59-794b2b941d83 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16872024-09-05T00:46:37.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ea81e839-b4d0-47e0-b38e-9ece86d7b25d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16882024-09-05T00:46:37.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ea81e839-b4d0-47e0-b38e-9ece86d7b25d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16892024-09-05T00:46:37.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2647 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ea81e839-b4d0-47e0-b38e-9ece86d7b25d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16902024-09-05T00:46:38.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 009d578c-cdbf-42ba-9cfb-76865c493959 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16912024-09-05T00:46:38.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 009d578c-cdbf-42ba-9cfb-76865c493959 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16922024-09-05T00:46:38.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 009d578c-cdbf-42ba-9cfb-76865c493959 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16932024-09-05T00:46:39.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ed63e114-3812-4332-9eaa-6e498d6dab82 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16942024-09-05T00:46:39.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ed63e114-3812-4332-9eaa-6e498d6dab82 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16952024-09-05T00:46:39.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1683 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ed63e114-3812-4332-9eaa-6e498d6dab82 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16962024-09-05T00:46:40.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6a1d289b-f3d3-4166-a052-033704e0e57a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16972024-09-05T00:46:40.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6a1d289b-f3d3-4166-a052-033704e0e57a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16982024-09-05T00:46:40.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6a1d289b-f3d3-4166-a052-033704e0e57a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
16992024-09-05T00:46:41.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e87db38e-89e3-438c-a6b9-e7a04ec28f6f roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17002024-09-05T00:46:41.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e87db38e-89e3-438c-a6b9-e7a04ec28f6f resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17012024-09-05T00:46:41.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e87db38e-89e3-438c-a6b9-e7a04ec28f6f response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17022024-09-05T00:46:43.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 95b0537c-6f8d-4f74-828e-f133fe1dd8e4 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17032024-09-05T00:46:43.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 95b0537c-6f8d-4f74-828e-f133fe1dd8e4 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17042024-09-05T00:46:43.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 95b0537c-6f8d-4f74-828e-f133fe1dd8e4 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17052024-09-05T00:46:44.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = eddadf4c-ea86-45a1-9af7-5e76658003ab roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17062024-09-05T00:46:44.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = eddadf4c-ea86-45a1-9af7-5e76658003ab resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17072024-09-05T00:46:44.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = eddadf4c-ea86-45a1-9af7-5e76658003ab response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17082024-09-05T00:46:44.955ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
17092024-09-05T00:46:44.955ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17102024-09-05T00:46:44.955ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
17112024-09-05T00:46:44.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17122024-09-05T00:46:44.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17132024-09-05T00:46:44.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17142024-09-05T00:46:44.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17152024-09-05T00:46:44.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17162024-09-05T00:46:44.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17172024-09-05T00:46:44.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.603742ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17182024-09-05T00:46:44.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17192024-09-05T00:46:44.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17202024-09-05T00:46:44.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17212024-09-05T00:46:44.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17222024-09-05T00:46:44.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17232024-09-05T00:46:44.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17242024-09-05T00:46:44.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
17252024-09-05T00:46:44.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17262024-09-05T00:46:44.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17272024-09-05T00:46:44.974ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
17282024-09-05T00:46:44.974ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.271353ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
17292024-09-05T00:46:45.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9f79d46e-a009-49e9-b09d-212eb5017595 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17302024-09-05T00:46:45.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9f79d46e-a009-49e9-b09d-212eb5017595 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17312024-09-05T00:46:45.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9f79d46e-a009-49e9-b09d-212eb5017595 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17322024-09-05T00:46:45.093ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1209 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 04c7d3cd-bcb1-45a7-a838-257f26f5446f response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
17332024-09-05T00:46:46.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ef2e6f2a-e5cc-4cc8-967c-c36fe3bcb831 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17342024-09-05T00:46:46.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ef2e6f2a-e5cc-4cc8-967c-c36fe3bcb831 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17352024-09-05T00:46:46.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ef2e6f2a-e5cc-4cc8-967c-c36fe3bcb831 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17362024-09-05T00:46:47.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7e435d28-d3a2-41c0-b669-24298484200e roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17372024-09-05T00:46:47.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7e435d28-d3a2-41c0-b669-24298484200e resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17382024-09-05T00:46:47.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1715 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7e435d28-d3a2-41c0-b669-24298484200e response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17392024-09-05T00:46:48.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d8828aac-a0c0-4894-a8f9-f5dd049f1d05 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17402024-09-05T00:46:48.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d8828aac-a0c0-4894-a8f9-f5dd049f1d05 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17412024-09-05T00:46:48.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d8828aac-a0c0-4894-a8f9-f5dd049f1d05 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17422024-09-05T00:46:49.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5702b4ec-5b8c-4659-b097-27b180a322f1 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17432024-09-05T00:46:49.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5702b4ec-5b8c-4659-b097-27b180a322f1 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17442024-09-05T00:46:49.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5702b4ec-5b8c-4659-b097-27b180a322f1 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17452024-09-05T00:46:50.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 22f6cf26-035f-4f2f-b8db-50783b407afc roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17462024-09-05T00:46:50.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 22f6cf26-035f-4f2f-b8db-50783b407afc resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17472024-09-05T00:46:50.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 22f6cf26-035f-4f2f-b8db-50783b407afc response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17482024-09-05T00:46:51.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 85a54884-634c-4b4a-a227-9f8d2a019052 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17492024-09-05T00:46:51.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 85a54884-634c-4b4a-a227-9f8d2a019052 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17502024-09-05T00:46:51.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1891 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 85a54884-634c-4b4a-a227-9f8d2a019052 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17512024-09-05T00:46:52.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 46c52f89-f4f1-442f-8afe-7b1ef74d5226 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17522024-09-05T00:46:52.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 46c52f89-f4f1-442f-8afe-7b1ef74d5226 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17532024-09-05T00:46:52.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 46c52f89-f4f1-442f-8afe-7b1ef74d5226 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17542024-09-05T00:46:53.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4bfb9023-841f-4f78-a0e6-6ac96aa950a2 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17552024-09-05T00:46:53.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4bfb9023-841f-4f78-a0e6-6ac96aa950a2 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17562024-09-05T00:46:53.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4bfb9023-841f-4f78-a0e6-6ac96aa950a2 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17572024-09-05T00:46:54.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 06044d3a-8b6a-4c2a-b030-af3ebb9d5fe4 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17582024-09-05T00:46:54.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 06044d3a-8b6a-4c2a-b030-af3ebb9d5fe4 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17592024-09-05T00:46:54.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 06044d3a-8b6a-4c2a-b030-af3ebb9d5fe4 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17602024-09-05T00:46:54.954ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
17612024-09-05T00:46:54.954ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
17622024-09-05T00:46:54.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17632024-09-05T00:46:54.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17642024-09-05T00:46:54.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17652024-09-05T00:46:54.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17662024-09-05T00:46:54.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17672024-09-05T00:46:54.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17682024-09-05T00:46:54.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17692024-09-05T00:46:54.958ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.394009ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17702024-09-05T00:46:54.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17712024-09-05T00:46:54.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17722024-09-05T00:46:54.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17732024-09-05T00:46:54.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17742024-09-05T00:46:54.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17752024-09-05T00:46:54.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17762024-09-05T00:46:54.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
17772024-09-05T00:46:54.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17782024-09-05T00:46:54.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17792024-09-05T00:46:54.973ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
17802024-09-05T00:46:54.973ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.622871ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
17812024-09-05T00:46:55.094ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1990 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 97b898c2-9e56-4319-9995-1898a24924f1 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
17822024-09-05T00:46:55.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 07130d97-7101-4a28-b46b-c23d1d0f500f roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17832024-09-05T00:46:55.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 07130d97-7101-4a28-b46b-c23d1d0f500f resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17842024-09-05T00:46:55.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 07130d97-7101-4a28-b46b-c23d1d0f500f response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17852024-09-05T00:46:56.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = acf9d04f-2a7c-4005-906a-7f5ff6bcb27b roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17862024-09-05T00:46:56.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = acf9d04f-2a7c-4005-906a-7f5ff6bcb27b resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17872024-09-05T00:46:56.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1792 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = acf9d04f-2a7c-4005-906a-7f5ff6bcb27b response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17882024-09-05T00:46:57.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1356cabc-4654-4477-971b-9e64c7617922 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17892024-09-05T00:46:57.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1356cabc-4654-4477-971b-9e64c7617922 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17902024-09-05T00:46:57.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2855 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1356cabc-4654-4477-971b-9e64c7617922 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17912024-09-05T00:46:58.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7667bd29-3682-46fd-a5a9-1335d9953023 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17922024-09-05T00:46:58.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7667bd29-3682-46fd-a5a9-1335d9953023 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17932024-09-05T00:46:58.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7667bd29-3682-46fd-a5a9-1335d9953023 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17942024-09-05T00:46:59.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0613a299-6b49-43fa-8c40-242f3a2fa100 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17952024-09-05T00:46:59.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0613a299-6b49-43fa-8c40-242f3a2fa100 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17962024-09-05T00:46:59.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0613a299-6b49-43fa-8c40-242f3a2fa100 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17972024-09-05T00:47:00.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9698df67-aa39-4bd8-9636-c0e4d27df507 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17982024-09-05T00:47:00.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9698df67-aa39-4bd8-9636-c0e4d27df507 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
17992024-09-05T00:47:00.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9698df67-aa39-4bd8-9636-c0e4d27df507 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
18002024-09-05T00:47:01.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2ab1e7f4-76aa-4c85-b8ba-61ab2a286806 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
18012024-09-05T00:47:01.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2ab1e7f4-76aa-4c85-b8ba-61ab2a286806 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
18022024-09-05T00:47:01.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2ab1e7f4-76aa-4c85-b8ba-61ab2a286806 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
18032024-09-05T00:47:02.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a6897de8-8e04-4f30-8677-0841e2ba23d5 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
18042024-09-05T00:47:02.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a6897de8-8e04-4f30-8677-0841e2ba23d5 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
18052024-09-05T00:47:02.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a6897de8-8e04-4f30-8677-0841e2ba23d5 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
18062024-09-05T00:47:03.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = cc2de402-f536-4ddd-8256-d79a31afcd83 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
18072024-09-05T00:47:03.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = cc2de402-f536-4ddd-8256-d79a31afcd83 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
18082024-09-05T00:47:03.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = cc2de402-f536-4ddd-8256-d79a31afcd83 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
18092024-09-05T00:47:04.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 838decaf-666f-4a6c-a26f-c9a1abc7bdf1 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
18102024-09-05T00:47:04.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 838decaf-666f-4a6c-a26f-c9a1abc7bdf1 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
18112024-09-05T00:47:04.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 838decaf-666f-4a6c-a26f-c9a1abc7bdf1 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
18122024-09-05T00:47:04.953ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
18132024-09-05T00:47:04.953ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18142024-09-05T00:47:04.953ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
18152024-09-05T00:47:04.953ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18162024-09-05T00:47:04.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18172024-09-05T00:47:04.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18182024-09-05T00:47:04.953ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
18192024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
18202024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
18212024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18222024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
18232024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18242024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18252024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
18262024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
18272024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18282024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18292024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
18302024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18312024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
18322024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18332024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18342024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
18352024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18362024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
18372024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18382024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
18392024-09-05T00:47:04.954ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18402024-09-05T00:47:04.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18412024-09-05T00:47:04.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18422024-09-05T00:47:04.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18432024-09-05T00:47:04.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18442024-09-05T00:47:04.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18452024-09-05T00:47:04.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18462024-09-05T00:47:04.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18472024-09-05T00:47:04.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18482024-09-05T00:47:04.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18492024-09-05T00:47:04.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18502024-09-05T00:47:04.955ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3687, tv_nsec: 22495929 } })
18512024-09-05T00:47:04.956ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
18522024-09-05T00:47:04.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18532024-09-05T00:47:04.956ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3687, tv_nsec: 23553118 } })
18542024-09-05T00:47:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18552024-09-05T00:47:04.957ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18562024-09-05T00:47:04.957ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
18572024-09-05T00:47:04.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18582024-09-05T00:47:04.958ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18592024-09-05T00:47:04.958ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.108553ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18602024-09-05T00:47:04.959ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
18612024-09-05T00:47:04.959ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
18622024-09-05T00:47:04.959ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
18632024-09-05T00:47:04.959ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18642024-09-05T00:47:04.959ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18652024-09-05T00:47:04.959ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
18662024-09-05T00:47:04.959ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18672024-09-05T00:47:04.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18682024-09-05T00:47:04.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18692024-09-05T00:47:04.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18702024-09-05T00:47:04.959ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18712024-09-05T00:47:04.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18722024-09-05T00:47:04.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18732024-09-05T00:47:04.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18742024-09-05T00:47:04.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18752024-09-05T00:47:04.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18762024-09-05T00:47:04.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18772024-09-05T00:47:04.960ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18782024-09-05T00:47:04.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18792024-09-05T00:47:04.961ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18802024-09-05T00:47:04.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18812024-09-05T00:47:04.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18822024-09-05T00:47:04.962ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18832024-09-05T00:47:04.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 8.361039ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18842024-09-05T00:47:04.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18852024-09-05T00:47:04.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18862024-09-05T00:47:04.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18872024-09-05T00:47:04.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18882024-09-05T00:47:04.965ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18892024-09-05T00:47:04.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18902024-09-05T00:47:04.965ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.623778ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
18912024-09-05T00:47:04.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18922024-09-05T00:47:04.969ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3687, tv_nsec: 35953498 } })
18932024-09-05T00:47:04.969ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18942024-09-05T00:47:04.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18952024-09-05T00:47:04.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18962024-09-05T00:47:04.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18972024-09-05T00:47:04.970ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18982024-09-05T00:47:04.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18992024-09-05T00:47:04.970ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
19002024-09-05T00:47:04.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19012024-09-05T00:47:04.972ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19022024-09-05T00:47:04.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19032024-09-05T00:47:04.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19042024-09-05T00:47:04.974ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19052024-09-05T00:47:04.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19062024-09-05T00:47:04.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
19072024-09-05T00:47:04.975ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19082024-09-05T00:47:04.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19092024-09-05T00:47:04.977ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19102024-09-05T00:47:04.977ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 22.795966ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19112024-09-05T00:47:04.987ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
19122024-09-05T00:47:04.987ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.436387ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
19132024-09-05T00:47:04.991ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
19142024-09-05T00:47:04.991ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19152024-09-05T00:47:04.991ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19162024-09-05T00:47:04.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19172024-09-05T00:47:04.996ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
19182024-09-05T00:47:04.996ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19192024-09-05T00:47:04.996ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 41.580031ms iteration = 10 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
19202024-09-05T00:47:05.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19212024-09-05T00:47:05.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19222024-09-05T00:47:05.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19232024-09-05T00:47:05.006ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 46.685441ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
19242024-09-05T00:47:05.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19252024-09-05T00:47:05.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19262024-09-05T00:47:05.006ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19272024-09-05T00:47:05.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19282024-09-05T00:47:05.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19292024-09-05T00:47:05.007ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19302024-09-05T00:47:05.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19312024-09-05T00:47:05.008ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 53.602704ms iteration = 10 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
19322024-09-05T00:47:05.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19332024-09-05T00:47:05.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19342024-09-05T00:47:05.030ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19352024-09-05T00:47:05.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19362024-09-05T00:47:05.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19372024-09-05T00:47:05.033ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19382024-09-05T00:47:05.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19392024-09-05T00:47:05.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a014d257-275c-449e-a4f4-aef00eab141c, lookup_type: ById(a014d257-275c-449e-a4f4-aef00eab141c) } result = Ok(())
19402024-09-05T00:47:05.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19412024-09-05T00:47:05.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19422024-09-05T00:47:05.036ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 81.134215ms iteration = 10 status = 0
19432024-09-05T00:47:05.042ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
19442024-09-05T00:47:05.042ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19452024-09-05T00:47:05.043ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5b0c701f-6375-4e83-82c1-8bb4d0d763eb", "content-length": "26", "date": "Thu, 05 Sep 2024 00:47:04 GMT"} })
19462024-09-05T00:47:05.043ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19472024-09-05T00:47:05.045ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19482024-09-05T00:47:05.047ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
19492024-09-05T00:47:05.047ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19502024-09-05T00:47:05.047ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0f25d968-f0a4-4162-a776-ea9ed406a8e7", "content-length": "26", "date": "Thu, 05 Sep 2024 00:47:04 GMT"} })
19512024-09-05T00:47:05.047ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19522024-09-05T00:47:05.049ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19532024-09-05T00:47:05.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = bac77ab1-3d2e-4569-9477-68343b0dd4a4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
19542024-09-05T00:47:05.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = bac77ab1-3d2e-4569-9477-68343b0dd4a4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
19552024-09-05T00:47:05.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = bac77ab1-3d2e-4569-9477-68343b0dd4a4 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
19562024-09-05T00:47:05.055ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19572024-09-05T00:47:05.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19582024-09-05T00:47:05.059ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
19592024-09-05T00:47:05.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 100.627521ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
19602024-09-05T00:47:05.065ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b zone_address = fd00:1122:3344:101::2
19612024-09-05T00:47:05.065ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19622024-09-05T00:47:05.065ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b2eec8f4-40e3-4a7e-9e7b-a2c2c3c76c77", "content-length": "26", "date": "Thu, 05 Sep 2024 00:47:04 GMT"} })
19632024-09-05T00:47:05.065ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19642024-09-05T00:47:05.066ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
19652024-09-05T00:47:05.067ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19662024-09-05T00:47:05.071ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 116.236209ms iteration = 13 status = {"physical_disks_added":0}
19672024-09-05T00:47:05.087ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e731eca0-6776-4008-8fc6-7ced3d378e50", "content-length": "372", "date": "Thu, 05 Sep 2024 00:47:04 GMT"} })
19682024-09-05T00:47:05.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19692024-09-05T00:47:05.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19702024-09-05T00:47:05.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19712024-09-05T00:47:05.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19722024-09-05T00:47:05.094ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1753 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 1c84da2e-9735-4f88-bcf7-cb5926b885ab response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
19732024-09-05T00:47:05.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19742024-09-05T00:47:05.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19752024-09-05T00:47:05.098ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19762024-09-05T00:47:05.098ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4c5aeb5f-df53-42cb-977e-979b0aec1098", "date": "Thu, 05 Sep 2024 00:47:04 GMT"} })
19772024-09-05T00:47:05.101ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 146.198402ms iteration = 11 status = {}
19782024-09-05T00:47:05.136ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19792024-09-05T00:47:05.137ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fecd243b-99ea-4eed-a605-78a5200f0d16", "content-length": "1", "date": "Thu, 05 Sep 2024 00:47:04 GMT"} })
19802024-09-05T00:47:05.138ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19812024-09-05T00:47:05.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19822024-09-05T00:47:05.140ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19832024-09-05T00:47:05.140ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 187.724591ms iteration = 10 status = null
19842024-09-05T00:47:05.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19852024-09-05T00:47:05.142ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19862024-09-05T00:47:05.143ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19872024-09-05T00:47:05.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19882024-09-05T00:47:05.143ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 190.812987ms iteration = 10 status = {}
19892024-09-05T00:47:05.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19902024-09-05T00:47:05.145ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19912024-09-05T00:47:05.146ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19922024-09-05T00:47:05.146ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19932024-09-05T00:47:05.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19942024-09-05T00:47:05.187ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
19952024-09-05T00:47:05.188ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7df12480-780f-4dbf-a9b8-95f521df5f67", "content-length": "691", "date": "Thu, 05 Sep 2024 00:47:04 GMT"} })
19962024-09-05T00:47:05.188ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
19972024-09-05T00:47:05.188ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
19982024-09-05T00:47:05.188ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
19992024-09-05T00:47:05.190ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 235.555253ms iteration = 10 status = {}
20002024-09-05T00:47:05.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20012024-09-05T00:47:05.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20022024-09-05T00:47:05.218ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 3013d0b1-47fb-4df1-97e5-7049d1043033, rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c4762fe-488f-4054-979a-f54d371ea654) } rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
20032024-09-05T00:47:05.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20042024-09-05T00:47:05.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20052024-09-05T00:47:05.228ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20062024-09-05T00:47:05.228ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dd2b3454-798e-430a-965d-01bed6d8d128", "content-length": "121", "date": "Thu, 05 Sep 2024 00:47:04 GMT"} })
20072024-09-05T00:47:05.228ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
20082024-09-05T00:47:05.228ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c4762fe-488f-4054-979a-f54d371ea654
20092024-09-05T00:47:05.228ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20102024-09-05T00:47:05.228ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20112024-09-05T00:47:05.228ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
20122024-09-05T00:47:05.228ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
20132024-09-05T00:47:05.228ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
20142024-09-05T00:47:05.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20152024-09-05T00:47:05.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20162024-09-05T00:47:05.229ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20172024-09-05T00:47:05.230ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "98f8847e-2554-4b18-812c-8b23239265c1", "content-length": "2", "date": "Thu, 05 Sep 2024 00:47:04 GMT"} })
20182024-09-05T00:47:05.230ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20192024-09-05T00:47:05.230ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4a658d8f-3b3f-4841-886e-e06c67cdeeca", "content-length": "51", "date": "Thu, 05 Sep 2024 00:47:04 GMT"} })
20202024-09-05T00:47:05.230ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
20212024-09-05T00:47:05.230ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20222024-09-05T00:47:05.320ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bbe6ffe0-eafe-404b-a1e7-a9e91853992a", "date": "Thu, 05 Sep 2024 00:47:04 GMT"} })
20232024-09-05T00:47:05.320ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch = Switch0
20242024-09-05T00:47:05.320ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20252024-09-05T00:47:05.320ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fc3ff8d8-710c-4b5c-8ac2-6a3ba90037d3", "content-length": "667", "date": "Thu, 05 Sep 2024 00:47:04 GMT"} })
20262024-09-05T00:47:05.320ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20272024-09-05T00:47:05.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20282024-09-05T00:47:05.327ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20292024-09-05T00:47:05.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20302024-09-05T00:47:05.330ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20312024-09-05T00:47:05.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20322024-09-05T00:47:05.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20332024-09-05T00:47:05.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20342024-09-05T00:47:05.341ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 386.895147ms iteration = 10 status = {}
20352024-09-05T00:47:05.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = dbee43e5-0a05-4c20-a19e-d9d4d2f0aa48 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20362024-09-05T00:47:05.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = dbee43e5-0a05-4c20-a19e-d9d4d2f0aa48 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20372024-09-05T00:47:05.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1752 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = dbee43e5-0a05-4c20-a19e-d9d4d2f0aa48 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20382024-09-05T00:47:06.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = acdf21ca-45e2-4a31-a863-97596314386a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20392024-09-05T00:47:06.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = acdf21ca-45e2-4a31-a863-97596314386a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20402024-09-05T00:47:06.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1616 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = acdf21ca-45e2-4a31-a863-97596314386a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20412024-09-05T00:47:07.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7c67b925-7b95-4fb1-9725-a72e0ec4e29d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20422024-09-05T00:47:07.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7c67b925-7b95-4fb1-9725-a72e0ec4e29d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20432024-09-05T00:47:07.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7c67b925-7b95-4fb1-9725-a72e0ec4e29d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20442024-09-05T00:47:08.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0c5be4ed-4eb9-4ecd-9377-45b088fa9670 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20452024-09-05T00:47:08.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0c5be4ed-4eb9-4ecd-9377-45b088fa9670 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20462024-09-05T00:47:08.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2348 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0c5be4ed-4eb9-4ecd-9377-45b088fa9670 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20472024-09-05T00:47:09.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fe4a35b8-1cb5-40c2-9d48-1f87f5747424 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20482024-09-05T00:47:09.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fe4a35b8-1cb5-40c2-9d48-1f87f5747424 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20492024-09-05T00:47:09.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fe4a35b8-1cb5-40c2-9d48-1f87f5747424 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20502024-09-05T00:47:10.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9a9858c9-1016-4c3a-9e93-bc1266a01045 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20512024-09-05T00:47:10.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9a9858c9-1016-4c3a-9e93-bc1266a01045 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20522024-09-05T00:47:10.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9a9858c9-1016-4c3a-9e93-bc1266a01045 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20532024-09-05T00:47:11.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4761c4d9-14f7-4ac7-b4dc-4df3bb57a301 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20542024-09-05T00:47:11.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4761c4d9-14f7-4ac7-b4dc-4df3bb57a301 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20552024-09-05T00:47:11.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1857 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4761c4d9-14f7-4ac7-b4dc-4df3bb57a301 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20562024-09-05T00:47:12.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = eefaac77-6587-4f94-a005-be9077468a11 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20572024-09-05T00:47:12.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = eefaac77-6587-4f94-a005-be9077468a11 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20582024-09-05T00:47:12.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = eefaac77-6587-4f94-a005-be9077468a11 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20592024-09-05T00:47:13.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6d4aa4e1-6e87-4a4f-906e-7228ac4bb935 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20602024-09-05T00:47:13.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6d4aa4e1-6e87-4a4f-906e-7228ac4bb935 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20612024-09-05T00:47:13.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6d4aa4e1-6e87-4a4f-906e-7228ac4bb935 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20622024-09-05T00:47:14.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3006aed7-de1e-418b-9758-2e8be2388886 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20632024-09-05T00:47:14.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3006aed7-de1e-418b-9758-2e8be2388886 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20642024-09-05T00:47:14.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3006aed7-de1e-418b-9758-2e8be2388886 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20652024-09-05T00:47:14.955ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
20662024-09-05T00:47:14.955ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
20672024-09-05T00:47:14.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20682024-09-05T00:47:14.955ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20692024-09-05T00:47:14.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20702024-09-05T00:47:14.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20712024-09-05T00:47:14.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20722024-09-05T00:47:14.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20732024-09-05T00:47:14.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20742024-09-05T00:47:14.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20752024-09-05T00:47:14.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20762024-09-05T00:47:14.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20772024-09-05T00:47:14.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20782024-09-05T00:47:14.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20792024-09-05T00:47:14.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20802024-09-05T00:47:14.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
20812024-09-05T00:47:14.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20822024-09-05T00:47:14.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20832024-09-05T00:47:14.972ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
20842024-09-05T00:47:14.972ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.661904ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
20852024-09-05T00:47:14.984ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.899635ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20862024-09-05T00:47:15.094ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1720 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 28a20f56-04c2-451c-9994-13e045d86c7e response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
20872024-09-05T00:47:15.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 77789e32-e99a-46de-b388-1026fb00faa9 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20882024-09-05T00:47:15.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 77789e32-e99a-46de-b388-1026fb00faa9 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20892024-09-05T00:47:15.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 77789e32-e99a-46de-b388-1026fb00faa9 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20902024-09-05T00:47:16.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ad702f4b-9565-428e-aad2-8b2e23699f8d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20912024-09-05T00:47:16.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ad702f4b-9565-428e-aad2-8b2e23699f8d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20922024-09-05T00:47:16.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ad702f4b-9565-428e-aad2-8b2e23699f8d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20932024-09-05T00:47:17.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 26352d0f-93be-49fe-88c4-83ccb8f47a13 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20942024-09-05T00:47:17.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 26352d0f-93be-49fe-88c4-83ccb8f47a13 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20952024-09-05T00:47:17.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 26352d0f-93be-49fe-88c4-83ccb8f47a13 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20962024-09-05T00:47:18.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a282a661-fae1-437d-bf06-dd2df64027d9 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20972024-09-05T00:47:18.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a282a661-fae1-437d-bf06-dd2df64027d9 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20982024-09-05T00:47:18.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a282a661-fae1-437d-bf06-dd2df64027d9 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
20992024-09-05T00:47:19.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 24e35507-fb0f-4e19-b41b-aeb1b8c989b3 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21002024-09-05T00:47:19.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 24e35507-fb0f-4e19-b41b-aeb1b8c989b3 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21012024-09-05T00:47:19.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2075 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 24e35507-fb0f-4e19-b41b-aeb1b8c989b3 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21022024-09-05T00:47:20.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 386745b4-3c0d-45f1-9ff9-d27590d96042 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21032024-09-05T00:47:20.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 386745b4-3c0d-45f1-9ff9-d27590d96042 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21042024-09-05T00:47:20.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 386745b4-3c0d-45f1-9ff9-d27590d96042 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21052024-09-05T00:47:21.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = eeee613c-2f84-40d7-9a38-ad6551d2efc0 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21062024-09-05T00:47:21.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = eeee613c-2f84-40d7-9a38-ad6551d2efc0 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21072024-09-05T00:47:21.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = eeee613c-2f84-40d7-9a38-ad6551d2efc0 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21082024-09-05T00:47:22.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7c40a35f-b703-40e9-b6b1-802e819cacc4 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21092024-09-05T00:47:22.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7c40a35f-b703-40e9-b6b1-802e819cacc4 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21102024-09-05T00:47:22.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2076 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7c40a35f-b703-40e9-b6b1-802e819cacc4 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21112024-09-05T00:47:23.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a9171e51-cf98-42e6-a15e-241479a44de4 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21122024-09-05T00:47:23.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a9171e51-cf98-42e6-a15e-241479a44de4 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21132024-09-05T00:47:23.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2566 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a9171e51-cf98-42e6-a15e-241479a44de4 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21142024-09-05T00:47:24.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e93f2a56-1e08-4402-861e-6ea2e866761c roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21152024-09-05T00:47:24.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e93f2a56-1e08-4402-861e-6ea2e866761c resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21162024-09-05T00:47:24.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e93f2a56-1e08-4402-861e-6ea2e866761c response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21172024-09-05T00:47:24.955ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
21182024-09-05T00:47:24.955ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
21192024-09-05T00:47:24.955ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21202024-09-05T00:47:24.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21212024-09-05T00:47:24.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21222024-09-05T00:47:24.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21232024-09-05T00:47:24.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21242024-09-05T00:47:24.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21252024-09-05T00:47:24.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21262024-09-05T00:47:24.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21272024-09-05T00:47:24.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21282024-09-05T00:47:24.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21292024-09-05T00:47:24.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21302024-09-05T00:47:24.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21312024-09-05T00:47:24.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21322024-09-05T00:47:24.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
21332024-09-05T00:47:24.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21342024-09-05T00:47:24.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21352024-09-05T00:47:24.973ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
21362024-09-05T00:47:24.973ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.181293ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
21372024-09-05T00:47:24.983ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.932067ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21382024-09-05T00:47:25.094ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = e5e67107-7bae-4951-9635-b9e644fa2292 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
21392024-09-05T00:47:25.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a74d8d61-301e-4180-ae93-5be0f5d25836 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21402024-09-05T00:47:25.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a74d8d61-301e-4180-ae93-5be0f5d25836 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21412024-09-05T00:47:25.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a74d8d61-301e-4180-ae93-5be0f5d25836 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21422024-09-05T00:47:26.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 557e88a3-e967-4d90-846a-1ea3e16ddd68 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21432024-09-05T00:47:26.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 557e88a3-e967-4d90-846a-1ea3e16ddd68 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21442024-09-05T00:47:26.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 557e88a3-e967-4d90-846a-1ea3e16ddd68 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21452024-09-05T00:47:27.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b4538f4f-169f-4cfc-9850-e4216dd4dbe6 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21462024-09-05T00:47:27.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b4538f4f-169f-4cfc-9850-e4216dd4dbe6 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21472024-09-05T00:47:27.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1847 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b4538f4f-169f-4cfc-9850-e4216dd4dbe6 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21482024-09-05T00:47:28.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a3fb6f86-8142-4185-a912-1e2c29164630 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21492024-09-05T00:47:28.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a3fb6f86-8142-4185-a912-1e2c29164630 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21502024-09-05T00:47:28.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a3fb6f86-8142-4185-a912-1e2c29164630 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21512024-09-05T00:47:29.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 25096fd2-3757-47fb-ac66-211a4284adbc roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21522024-09-05T00:47:29.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 25096fd2-3757-47fb-ac66-211a4284adbc resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21532024-09-05T00:47:29.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 25096fd2-3757-47fb-ac66-211a4284adbc response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21542024-09-05T00:47:31.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b7b07301-3c1c-4073-9146-fdea97833005 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21552024-09-05T00:47:31.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b7b07301-3c1c-4073-9146-fdea97833005 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21562024-09-05T00:47:31.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2839 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b7b07301-3c1c-4073-9146-fdea97833005 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21572024-09-05T00:47:32.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 470636f3-56cb-4960-b4bc-e9af284d2b6d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21582024-09-05T00:47:32.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 470636f3-56cb-4960-b4bc-e9af284d2b6d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21592024-09-05T00:47:32.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 470636f3-56cb-4960-b4bc-e9af284d2b6d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21602024-09-05T00:47:33.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 02a69bba-96ce-4340-8c99-47869eec7f5a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21612024-09-05T00:47:33.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 02a69bba-96ce-4340-8c99-47869eec7f5a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21622024-09-05T00:47:33.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 02a69bba-96ce-4340-8c99-47869eec7f5a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21632024-09-05T00:47:34.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 94b5de65-172a-4173-a04a-e12cbe999028 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21642024-09-05T00:47:34.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 94b5de65-172a-4173-a04a-e12cbe999028 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21652024-09-05T00:47:34.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 94b5de65-172a-4173-a04a-e12cbe999028 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
21662024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
21672024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
21682024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21692024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
21702024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
21712024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
21722024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
21732024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21742024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
21752024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
21762024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
21772024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21782024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
21792024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
21802024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
21812024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21822024-09-05T00:47:34.953ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-05 00:37:34.953723893 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
21832024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
21842024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
21852024-09-05T00:47:34.953ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
21862024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
21872024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21882024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21892024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
21902024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21912024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21922024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
21932024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
21942024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21952024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
21962024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21972024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21982024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
21992024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
22002024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22012024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22022024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22032024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
22042024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22052024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
22062024-09-05T00:47:34.954ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22072024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
22082024-09-05T00:47:34.955ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
22092024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
22102024-09-05T00:47:34.955ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
22112024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22122024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22132024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
22142024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22152024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
22162024-09-05T00:47:34.955ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59
22172024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.47\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59"}
22182024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
22192024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
22202024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22212024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22222024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22232024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22242024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22252024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22262024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22272024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22282024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22292024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22302024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22312024-09-05T00:47:34.955ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("145d6d08-bb1c-4557-af3d-b3b8e647b114.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4aa18504-a7e8-4aa1-94fe-a65abab62a4b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("4aa18504-a7e8-4aa1-94fe-a65abab62a4b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3717, tv_nsec: 21929717 } })
22322024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22332024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22342024-09-05T00:47:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22352024-09-05T00:47:34.955ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c51ae87-cbaf-4403-8e7a-91ae1f6a480f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89145bfe-85a8-47ae-9826-e73f4757fe92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("972980d1-78ce-4b3e-8b23-36e1a0e30ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("972980d1-78ce-4b3e-8b23-36e1a0e30ffb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 3717, tv_nsec: 22104040 } })
22362024-09-05T00:47:34.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22372024-09-05T00:47:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22382024-09-05T00:47:34.956ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
22392024-09-05T00:47:34.956ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.171726ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
22402024-09-05T00:47:34.957ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22412024-09-05T00:47:34.958ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
22422024-09-05T00:47:34.958ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.418089ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
22432024-09-05T00:47:34.958ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.379078ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22442024-09-05T00:47:34.958ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22452024-09-05T00:47:34.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22462024-09-05T00:47:34.959ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
22472024-09-05T00:47:34.959ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22482024-09-05T00:47:34.959ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-05 00:37:34.953723893 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
22492024-09-05T00:47:34.959ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
22502024-09-05T00:47:34.959ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
22512024-09-05T00:47:34.959ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
22522024-09-05T00:47:34.959ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.655381ms iteration = 6 status = {"expiration":"2024-09-05T00:37:34.953723893Z","pruned":[]}
22532024-09-05T00:47:34.959ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
22542024-09-05T00:47:34.959ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
22552024-09-05T00:47:34.959ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
22562024-09-05T00:47:34.959ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22572024-09-05T00:47:34.959ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
22582024-09-05T00:47:34.959ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
22592024-09-05T00:47:34.959ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
22602024-09-05T00:47:34.959ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3717, tv_nsec: 26000479 } })
22612024-09-05T00:47:34.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22622024-09-05T00:47:34.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22632024-09-05T00:47:34.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
22642024-09-05T00:47:34.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
22652024-09-05T00:47:34.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
22662024-09-05T00:47:34.959ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
22672024-09-05T00:47:34.960ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22682024-09-05T00:47:34.960ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22692024-09-05T00:47:34.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22702024-09-05T00:47:34.961ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22712024-09-05T00:47:34.961ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3717, tv_nsec: 27957844 } })
22722024-09-05T00:47:34.961ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
22732024-09-05T00:47:34.962ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22742024-09-05T00:47:34.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22752024-09-05T00:47:34.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22762024-09-05T00:47:34.963ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22772024-09-05T00:47:34.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
22782024-09-05T00:47:34.964ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22792024-09-05T00:47:34.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22802024-09-05T00:47:34.965ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22812024-09-05T00:47:34.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22822024-09-05T00:47:34.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22832024-09-05T00:47:34.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
22842024-09-05T00:47:34.966ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22852024-09-05T00:47:34.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22862024-09-05T00:47:34.967ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
22872024-09-05T00:47:34.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
22882024-09-05T00:47:34.969ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22892024-09-05T00:47:34.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22902024-09-05T00:47:34.969ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22912024-09-05T00:47:34.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
22922024-09-05T00:47:34.972ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22932024-09-05T00:47:34.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22942024-09-05T00:47:34.972ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22952024-09-05T00:47:34.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22962024-09-05T00:47:34.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22972024-09-05T00:47:34.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22982024-09-05T00:47:34.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22992024-09-05T00:47:34.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23002024-09-05T00:47:34.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23012024-09-05T00:47:34.978ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.516327ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
23022024-09-05T00:47:34.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23032024-09-05T00:47:34.982ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23042024-09-05T00:47:34.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23052024-09-05T00:47:34.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23062024-09-05T00:47:34.984ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23072024-09-05T00:47:34.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23082024-09-05T00:47:34.984ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23092024-09-05T00:47:34.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23102024-09-05T00:47:34.985ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23112024-09-05T00:47:34.985ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23122024-09-05T00:47:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23132024-09-05T00:47:34.986ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23142024-09-05T00:47:34.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23152024-09-05T00:47:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23162024-09-05T00:47:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23172024-09-05T00:47:34.987ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23182024-09-05T00:47:34.989ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23192024-09-05T00:47:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23202024-09-05T00:47:34.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
23212024-09-05T00:47:34.990ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23222024-09-05T00:47:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23232024-09-05T00:47:34.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23242024-09-05T00:47:34.998ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23252024-09-05T00:47:34.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
23262024-09-05T00:47:34.998ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23272024-09-05T00:47:34.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23282024-09-05T00:47:34.999ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23292024-09-05T00:47:34.999ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 44.868089ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23302024-09-05T00:47:35.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23312024-09-05T00:47:35.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23322024-09-05T00:47:35.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23332024-09-05T00:47:35.004ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23342024-09-05T00:47:35.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23352024-09-05T00:47:35.011ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3717, tv_nsec: 77686449 } })
23362024-09-05T00:47:35.011ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
23372024-09-05T00:47:35.014ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23382024-09-05T00:47:35.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23392024-09-05T00:47:35.018ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23402024-09-05T00:47:35.018ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23412024-09-05T00:47:35.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23422024-09-05T00:47:35.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23432024-09-05T00:47:35.020ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
23442024-09-05T00:47:35.020ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
23452024-09-05T00:47:35.020ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23462024-09-05T00:47:35.020ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
23472024-09-05T00:47:35.020ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 65.490486ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
23482024-09-05T00:47:35.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23492024-09-05T00:47:35.024ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23502024-09-05T00:47:35.026ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23512024-09-05T00:47:35.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23522024-09-05T00:47:35.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
23532024-09-05T00:47:35.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23542024-09-05T00:47:35.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23552024-09-05T00:47:35.029ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
23562024-09-05T00:47:35.029ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
23572024-09-05T00:47:35.029ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.670241ms iteration = 6 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
23582024-09-05T00:47:35.032ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23592024-09-05T00:47:35.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23602024-09-05T00:47:35.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23612024-09-05T00:47:35.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.296399ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23622024-09-05T00:47:35.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23632024-09-05T00:47:35.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23642024-09-05T00:47:35.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23652024-09-05T00:47:35.039ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
23662024-09-05T00:47:35.039ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
23672024-09-05T00:47:35.039ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
23682024-09-05T00:47:35.039ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23692024-09-05T00:47:35.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23702024-09-05T00:47:35.040ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 80.726987ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
23712024-09-05T00:47:35.042ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
23722024-09-05T00:47:35.042ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
23732024-09-05T00:47:35.042ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.499088ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
23742024-09-05T00:47:35.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23752024-09-05T00:47:35.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23762024-09-05T00:47:35.045ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23772024-09-05T00:47:35.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23782024-09-05T00:47:35.061ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23792024-09-05T00:47:35.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23802024-09-05T00:47:35.061ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23812024-09-05T00:47:35.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23822024-09-05T00:47:35.063ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23832024-09-05T00:47:35.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23842024-09-05T00:47:35.065ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23852024-09-05T00:47:35.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23862024-09-05T00:47:35.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23872024-09-05T00:47:35.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23882024-09-05T00:47:35.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23892024-09-05T00:47:35.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23902024-09-05T00:47:35.070ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23912024-09-05T00:47:35.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a014d257-275c-449e-a4f4-aef00eab141c, lookup_type: ById(a014d257-275c-449e-a4f4-aef00eab141c) } result = Ok(())
23922024-09-05T00:47:35.073ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23932024-09-05T00:47:35.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 118.221685ms iteration = 11 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
23942024-09-05T00:47:35.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23952024-09-05T00:47:35.074ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23962024-09-05T00:47:35.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23972024-09-05T00:47:35.075ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 120.423014ms iteration = 11 status = 0
23982024-09-05T00:47:35.076ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23992024-09-05T00:47:35.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24002024-09-05T00:47:35.077ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
24012024-09-05T00:47:35.077ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24022024-09-05T00:47:35.077ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.671613ms iteration = 11 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
24032024-09-05T00:47:35.078ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24042024-09-05T00:47:35.081ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 126.507891ms iteration = 14 status = {"physical_disks_added":0}
24052024-09-05T00:47:35.081ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
24062024-09-05T00:47:35.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
24072024-09-05T00:47:35.081ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24082024-09-05T00:47:35.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24092024-09-05T00:47:35.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 58bfc9fc-cdc4-4f5f-a151-e48b98a2a8e8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
24102024-09-05T00:47:35.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 58bfc9fc-cdc4-4f5f-a151-e48b98a2a8e8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
24112024-09-05T00:47:35.089ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24122024-09-05T00:47:35.089ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
24132024-09-05T00:47:35.089ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24142024-09-05T00:47:35.090ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3e9dfa86-7e21-446d-b626-89c31c6bfec5", "content-length": "26", "date": "Thu, 05 Sep 2024 00:47:34 GMT"} })
24152024-09-05T00:47:35.090ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24162024-09-05T00:47:35.090ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
24172024-09-05T00:47:35.090ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
24182024-09-05T00:47:35.090ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
24192024-09-05T00:47:35.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24202024-09-05T00:47:35.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24212024-09-05T00:47:35.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 132.477688ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
24222024-09-05T00:47:35.091ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24232024-09-05T00:47:35.094ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 568343a5-7ff6-4ffe-9fe0-5b48e05c1f04 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
24242024-09-05T00:47:35.104ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
24252024-09-05T00:47:35.104ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 145.147153ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
24262024-09-05T00:47:35.110ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24272024-09-05T00:47:35.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24282024-09-05T00:47:35.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = be079bd1-7e65-4e0c-9549-dc343c7e3c70 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
24292024-09-05T00:47:35.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = be079bd1-7e65-4e0c-9549-dc343c7e3c70 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
24302024-09-05T00:47:35.111ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
24312024-09-05T00:47:35.111ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 32541e10-8a85-4410-9858-67a9ab52251d dns_zone_name = oxide.test found_so_far = 0 version = 2
24322024-09-05T00:47:35.111ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24332024-09-05T00:47:35.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24342024-09-05T00:47:35.118ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-05T00:42:33.143008Z, time_modified: 2024-09-05T00:42:33.143008Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2d4fccaa-0031-45b8-a053-9531608bab06, db_silo: Silo { identity: SiloIdentity { id: 2d4fccaa-0031-45b8-a053-9531608bab06, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-05T00:42:43.791199Z, time_modified: 2024-09-05T00:42:43.791199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2d4fccaa-0031-45b8-a053-9531608bab06, db_silo: Silo { identity: SiloIdentity { id: 2d4fccaa-0031-45b8-a053-9531608bab06, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-05T00:42:43.791199Z, time_modified: 2024-09-05T00:42:43.791199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017" }] }) }
24352024-09-05T00:47:35.118ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 164.783322ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2d4fccaa-0031-45b8-a053-9531608bab06","tls_certs":["a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017"]}},"default_endpoint":{"silo_id":"2d4fccaa-0031-45b8-a053-9531608bab06","tls_certs":["a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
24362024-09-05T00:47:35.161ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
24372024-09-05T00:47:35.161ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24382024-09-05T00:47:35.162ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "055dcee8-c08e-4f47-866d-bc5cdf507bc2", "content-length": "26", "date": "Thu, 05 Sep 2024 00:47:34 GMT"} })
24392024-09-05T00:47:35.162ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24402024-09-05T00:47:35.164ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24412024-09-05T00:47:35.235ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b zone_address = fd00:1122:3344:101::2
24422024-09-05T00:47:35.235ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24432024-09-05T00:47:35.236ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a2fe0fd8-70db-42ba-a55d-936c1701731d", "content-length": "26", "date": "Thu, 05 Sep 2024 00:47:34 GMT"} })
24442024-09-05T00:47:35.236ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24452024-09-05T00:47:35.238ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
24462024-09-05T00:47:35.251ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24472024-09-05T00:47:35.255ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24482024-09-05T00:47:35.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24492024-09-05T00:47:35.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 170309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 58bfc9fc-cdc4-4f5f-a151-e48b98a2a8e8 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
24502024-09-05T00:47:35.256ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24512024-09-05T00:47:35.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 146783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = be079bd1-7e65-4e0c-9549-dc343c7e3c70 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
24522024-09-05T00:47:35.258ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24532024-09-05T00:47:35.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24542024-09-05T00:47:35.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24552024-09-05T00:47:35.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24562024-09-05T00:47:35.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24572024-09-05T00:47:35.262ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24582024-09-05T00:47:35.262ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 32541e10-8a85-4410-9858-67a9ab52251d dns_zone_name = oxide.test found_so_far = 1 version = 2
24592024-09-05T00:47:35.262ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
24602024-09-05T00:47:35.262ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-05 00:42:43.837540 UTC dns_group = external generation = 2
24612024-09-05T00:47:35.262ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 308.557193ms iteration = 7 status = {"generation":2}
24622024-09-05T00:47:35.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24632024-09-05T00:47:35.263ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
24642024-09-05T00:47:35.263ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "dc93f6d9-022a-4ce5-99f2-922b68dfa335", "date": "Thu, 05 Sep 2024 00:47:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24652024-09-05T00:47:35.263ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24662024-09-05T00:47:35.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24672024-09-05T00:47:35.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24682024-09-05T00:47:35.265ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6800e95a-210e-417d-b637-0ee6d9439bcf", "date": "Thu, 05 Sep 2024 00:47:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24692024-09-05T00:47:35.265ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24702024-09-05T00:47:35.268ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24712024-09-05T00:47:35.268ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 315.219482ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
24722024-09-05T00:47:35.284ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24732024-09-05T00:47:35.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24742024-09-05T00:47:35.287ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24752024-09-05T00:47:35.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24762024-09-05T00:47:35.290ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
24772024-09-05T00:47:35.290ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 59a6be26-b8fa-4e7a-8244-7a4e92426c26 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
24782024-09-05T00:47:35.290ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24792024-09-05T00:47:35.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24802024-09-05T00:47:35.291ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24812024-09-05T00:47:35.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24822024-09-05T00:47:35.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24832024-09-05T00:47:35.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24842024-09-05T00:47:35.297ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 59a6be26-b8fa-4e7a-8244-7a4e92426c26 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
24852024-09-05T00:47:35.297ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
24862024-09-05T00:47:35.297ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-05 00:42:43.011780 UTC dns_group = internal generation = 1
24872024-09-05T00:47:35.297ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 343.531595ms iteration = 7 status = {"generation":1}
24882024-09-05T00:47:35.297ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8d63b5b0-da27-4f19-8afd-9385851ab77c", "content-length": "372", "date": "Thu, 05 Sep 2024 00:47:34 GMT"} })
24892024-09-05T00:47:35.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24902024-09-05T00:47:35.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24912024-09-05T00:47:35.300ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24922024-09-05T00:47:35.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24932024-09-05T00:47:35.306ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24942024-09-05T00:47:35.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24952024-09-05T00:47:35.308ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24962024-09-05T00:47:35.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24972024-09-05T00:47:35.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24982024-09-05T00:47:35.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24992024-09-05T00:47:35.314ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25002024-09-05T00:47:35.314ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "dc2db822-9ec9-41b1-91f4-bb67b299140b", "date": "Thu, 05 Sep 2024 00:47:35 GMT"} })
25012024-09-05T00:47:35.314ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
25022024-09-05T00:47:35.315ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "59593c44-7065-4500-8555-cf1166c2bd47", "content-length": "1", "date": "Thu, 05 Sep 2024 00:47:34 GMT"} })
25032024-09-05T00:47:35.316ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 361.257661ms iteration = 12 status = {}
25042024-09-05T00:47:35.316ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25052024-09-05T00:47:35.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25062024-09-05T00:47:35.319ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 365.466716ms iteration = 11 status = null
25072024-09-05T00:47:35.332ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
25082024-09-05T00:47:35.341ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25092024-09-05T00:47:35.345ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
25102024-09-05T00:47:35.345ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25112024-09-05T00:47:35.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25122024-09-05T00:47:35.347ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25132024-09-05T00:47:35.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25142024-09-05T00:47:35.349ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25152024-09-05T00:47:35.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25162024-09-05T00:47:35.352ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25172024-09-05T00:47:35.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25182024-09-05T00:47:35.355ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25192024-09-05T00:47:35.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25202024-09-05T00:47:35.357ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25212024-09-05T00:47:35.357ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25222024-09-05T00:47:35.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25232024-09-05T00:47:35.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25242024-09-05T00:47:35.359ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25252024-09-05T00:47:35.359ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25262024-09-05T00:47:35.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25272024-09-05T00:47:35.360ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 407.25307ms iteration = 11 status = {}
25282024-09-05T00:47:35.360ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25292024-09-05T00:47:35.361ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25302024-09-05T00:47:35.361ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25312024-09-05T00:47:35.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25322024-09-05T00:47:35.363ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25332024-09-05T00:47:35.365ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25342024-09-05T00:47:35.365ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25352024-09-05T00:47:35.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25362024-09-05T00:47:35.365ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
25372024-09-05T00:47:35.365ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25382024-09-05T00:47:35.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25392024-09-05T00:47:35.367ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25402024-09-05T00:47:35.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25412024-09-05T00:47:35.368ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25422024-09-05T00:47:35.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25432024-09-05T00:47:35.370ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25442024-09-05T00:47:35.373ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
25452024-09-05T00:47:35.373ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25462024-09-05T00:47:35.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25472024-09-05T00:47:35.382ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25482024-09-05T00:47:35.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25492024-09-05T00:47:35.384ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25502024-09-05T00:47:35.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25512024-09-05T00:47:35.386ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25522024-09-05T00:47:35.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25532024-09-05T00:47:35.388ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25542024-09-05T00:47:35.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25552024-09-05T00:47:35.390ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25562024-09-05T00:47:35.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25572024-09-05T00:47:35.392ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25582024-09-05T00:47:35.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25592024-09-05T00:47:35.393ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:55281
25602024-09-05T00:47:35.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55281 req_id = 0b1f6024-4cbf-4207-84ba-a8bf9c3a1877 roles = RoleSet { roles: {} } uri = /metrics/producers
25612024-09-05T00:47:35.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55281 req_id = 0b1f6024-4cbf-4207-84ba-a8bf9c3a1877 resource = Database result = Ok(()) uri = /metrics/producers
25622024-09-05T00:47:35.394ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25632024-09-05T00:47:35.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25642024-09-05T00:47:35.395ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25652024-09-05T00:47:35.398ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
25662024-09-05T00:47:35.398ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25672024-09-05T00:47:35.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25682024-09-05T00:47:35.400ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25692024-09-05T00:47:35.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25702024-09-05T00:47:35.401ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25712024-09-05T00:47:35.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25722024-09-05T00:47:35.403ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25732024-09-05T00:47:35.406ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
25742024-09-05T00:47:35.406ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25752024-09-05T00:47:35.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25762024-09-05T00:47:35.423ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
25772024-09-05T00:47:35.425ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0bdf30f1-b9ef-4ada-bb1a-2edeca027588", "date": "Thu, 05 Sep 2024 00:47:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25782024-09-05T00:47:35.425ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25792024-09-05T00:47:35.427ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b316f007-453d-4e4e-9735-cbbf477b8b0a", "date": "Thu, 05 Sep 2024 00:47:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25802024-09-05T00:47:35.427ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25812024-09-05T00:47:35.429ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b9036b21-622c-45c5-a4cb-306b9ab09534", "date": "Thu, 05 Sep 2024 00:47:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25822024-09-05T00:47:35.429ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25832024-09-05T00:47:35.431ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
25842024-09-05T00:47:35.431ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 477.809637ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
25852024-09-05T00:47:35.487ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
25862024-09-05T00:47:35.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55281 req_id = 0b1f6024-4cbf-4207-84ba-a8bf9c3a1877 roles = RoleSet { roles: {} } uri = /metrics/producers
25872024-09-05T00:47:35.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55281 req_id = 0b1f6024-4cbf-4207-84ba-a8bf9c3a1877 resource = Database result = Ok(()) uri = /metrics/producers
25882024-09-05T00:47:35.492ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 4201fb72-62c9-4bc9-b4fd-ee3284095ee8, kind: Service { id: 145d6d08-bb1c-4557-af3d-b3b8e647b114 }, name: Name("external-dns-145d6d08-bb1c-4557-af3d-b3b8e647b114"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 139])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60a23721-fd77-4d33-a0a4-0735bb775681, kind: Service { id: 4aa18504-a7e8-4aa1-94fe-a65abab62a4b }, name: Name("external-dns-4aa18504-a7e8-4aa1-94fe-a65abab62a4b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 03971845-77e2-4239-964a-04e9c3f9d11e, kind: Service { id: c8b7e56a-4fd1-4100-8ded-5a17ea178a46 }, name: Name("nexus-c8b7e56a-4fd1-4100-8ded-5a17ea178a46"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9f0144bd-0194-4864-a015-629f3aebd42c, kind: Service { id: 7171adea-be80-48c5-a65b-fe3a55b4870d }, name: Name("nexus-7171adea-be80-48c5-a65b-fe3a55b4870d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fc066fb6-a099-4780-b3f0-61b984118b4f, kind: Service { id: 5f1fb376-349f-4b39-808a-5aa5abc60b1e }, name: Name("nexus-5f1fb376-349f-4b39-808a-5aa5abc60b1e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 225])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
25892024-09-05T00:47:35.492ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25902024-09-05T00:47:35.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25912024-09-05T00:47:35.494ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25922024-09-05T00:47:35.496ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
25932024-09-05T00:47:35.496ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25942024-09-05T00:47:35.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25952024-09-05T00:47:35.499ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
25962024-09-05T00:47:35.500ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "eef23315-f9fe-424f-be0a-d09c20ffd6a6", "content-length": "691", "date": "Thu, 05 Sep 2024 00:47:35 GMT"} })
25972024-09-05T00:47:35.500ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
25982024-09-05T00:47:35.500ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
25992024-09-05T00:47:35.500ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
26002024-09-05T00:47:35.501ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26012024-09-05T00:47:35.501ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
26022024-09-05T00:47:35.501ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 546.748553ms iteration = 11 status = {}
26032024-09-05T00:47:35.501ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4201fb72-62c9-4bc9-b4fd-ee3284095ee8, kind: Service { id: 145d6d08-bb1c-4557-af3d-b3b8e647b114 }, name: Name("external-dns-145d6d08-bb1c-4557-af3d-b3b8e647b114"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 139])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 60a23721-fd77-4d33-a0a4-0735bb775681, kind: Service { id: 4aa18504-a7e8-4aa1-94fe-a65abab62a4b }, name: Name("external-dns-4aa18504-a7e8-4aa1-94fe-a65abab62a4b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 03971845-77e2-4239-964a-04e9c3f9d11e, kind: Service { id: c8b7e56a-4fd1-4100-8ded-5a17ea178a46 }, name: Name("nexus-c8b7e56a-4fd1-4100-8ded-5a17ea178a46"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9f0144bd-0194-4864-a015-629f3aebd42c, kind: Service { id: 7171adea-be80-48c5-a65b-fe3a55b4870d }, name: Name("nexus-7171adea-be80-48c5-a65b-fe3a55b4870d"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fc066fb6-a099-4780-b3f0-61b984118b4f, kind: Service { id: 5f1fb376-349f-4b39-808a-5aa5abc60b1e }, name: Name("nexus-5f1fb376-349f-4b39-808a-5aa5abc60b1e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 225])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
26042024-09-05T00:47:35.501ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
26052024-09-05T00:47:35.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26062024-09-05T00:47:35.503ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 3013d0b1-47fb-4df1-97e5-7049d1043033, rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c4762fe-488f-4054-979a-f54d371ea654) } rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
26072024-09-05T00:47:35.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26082024-09-05T00:47:35.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26092024-09-05T00:47:35.514ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26102024-09-05T00:47:35.515ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ecd5ad8e-a64b-484c-a6ea-23c9e9e4f86d", "content-length": "121", "date": "Thu, 05 Sep 2024 00:47:34 GMT"} })
26112024-09-05T00:47:35.515ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
26122024-09-05T00:47:35.515ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
26132024-09-05T00:47:35.515ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c4762fe-488f-4054-979a-f54d371ea654
26142024-09-05T00:47:35.515ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "362685b6-2fb7-43fb-b2c8-32873f6b9244", "date": "Thu, 05 Sep 2024 00:47:35 GMT"} })
26152024-09-05T00:47:35.515ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = c2d58162-25ee-4e2a-9e85-e5ea2d681d4d
26162024-09-05T00:47:35.515ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26172024-09-05T00:47:35.516ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26182024-09-05T00:47:35.516ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
26192024-09-05T00:47:35.516ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
26202024-09-05T00:47:35.516ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
26212024-09-05T00:47:35.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26222024-09-05T00:47:35.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26232024-09-05T00:47:35.518ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26242024-09-05T00:47:35.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 124676 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55281 req_id = 0b1f6024-4cbf-4207-84ba-a8bf9c3a1877 response_code = 201 uri = /metrics/producers
26252024-09-05T00:47:35.518ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "44682a5d-d19f-41e3-abf2-f03d49567700", "content-length": "2", "date": "Thu, 05 Sep 2024 00:47:34 GMT"} })
26262024-09-05T00:47:35.518ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26272024-09-05T00:47:35.518ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "052314cd-4a9b-4256-9f6c-771a02031a1f", "content-length": "51", "date": "Thu, 05 Sep 2024 00:47:34 GMT"} })
26282024-09-05T00:47:35.518ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
26292024-09-05T00:47:35.518ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26302024-09-05T00:47:35.555ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: a014d257-275c-449e-a4f4-aef00eab141c, time_created: 2024-09-05T00:42:42.786093Z, time_modified: 2024-09-05T00:42:42.786093Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
26312024-09-05T00:47:35.555ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
26322024-09-05T00:47:35.555ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26332024-09-05T00:47:35.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26342024-09-05T00:47:35.558ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26352024-09-05T00:47:35.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26362024-09-05T00:47:35.559ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26372024-09-05T00:47:35.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: a014d257-275c-449e-a4f4-aef00eab141c, lookup_type: ById(a014d257-275c-449e-a4f4-aef00eab141c) } result = Ok(())
26382024-09-05T00:47:35.593ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26392024-09-05T00:47:35.610ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ee1efc63-6416-4b13-a26c-58891d386b16", "date": "Thu, 05 Sep 2024 00:47:35 GMT"} })
26402024-09-05T00:47:35.610ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch = Switch0
26412024-09-05T00:47:35.610ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26422024-09-05T00:47:35.610ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "07e45958-dda7-4932-bb5e-7c3b409edc58", "content-length": "667", "date": "Thu, 05 Sep 2024 00:47:35 GMT"} })
26432024-09-05T00:47:35.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26442024-09-05T00:47:35.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26452024-09-05T00:47:35.611ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = service_firewall_rule_propagation result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7b21ab59-5f57-48a1-ad32-cb2ae3cb3863", "date": "Thu, 05 Sep 2024 00:47:35 GMT"} })
26462024-09-05T00:47:35.614ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
26472024-09-05T00:47:35.614ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 659.072363ms
26482024-09-05T00:47:35.614ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 659.081023ms iteration = 2 status = {}
26492024-09-05T00:47:35.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26502024-09-05T00:47:35.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26512024-09-05T00:47:35.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26522024-09-05T00:47:35.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26532024-09-05T00:47:35.619ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26542024-09-05T00:47:35.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26552024-09-05T00:47:35.627ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 672.33377ms iteration = 11 status = {}
26562024-09-05T00:47:36.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b333ddee-be88-44e1-9878-9d973f326334 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26572024-09-05T00:47:36.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b333ddee-be88-44e1-9878-9d973f326334 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26582024-09-05T00:47:36.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b333ddee-be88-44e1-9878-9d973f326334 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26592024-09-05T00:47:37.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 65fb6ad6-4560-42b3-9897-69ae73ef9574 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26602024-09-05T00:47:37.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 65fb6ad6-4560-42b3-9897-69ae73ef9574 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26612024-09-05T00:47:37.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 65fb6ad6-4560-42b3-9897-69ae73ef9574 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26622024-09-05T00:47:38.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c89bb467-d26f-47da-b819-ff81f73b6342 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26632024-09-05T00:47:38.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c89bb467-d26f-47da-b819-ff81f73b6342 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26642024-09-05T00:47:38.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2597 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c89bb467-d26f-47da-b819-ff81f73b6342 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26652024-09-05T00:47:39.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5f461c6e-9c0b-43f9-99a2-fdda8ab9e976 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26662024-09-05T00:47:39.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5f461c6e-9c0b-43f9-99a2-fdda8ab9e976 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26672024-09-05T00:47:39.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2889 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5f461c6e-9c0b-43f9-99a2-fdda8ab9e976 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26682024-09-05T00:47:39.511ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:39097
26692024-09-05T00:47:39.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39097 req_id = 37322e0f-bdd5-4a73-aaee-724b787deb03 roles = RoleSet { roles: {} } uri = /metrics/producers
26702024-09-05T00:47:39.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39097 req_id = 37322e0f-bdd5-4a73-aaee-724b787deb03 resource = Database result = Ok(()) uri = /metrics/producers
26712024-09-05T00:47:39.544ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
26722024-09-05T00:47:39.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39097 req_id = 37322e0f-bdd5-4a73-aaee-724b787deb03 roles = RoleSet { roles: {} } uri = /metrics/producers
26732024-09-05T00:47:39.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39097 req_id = 37322e0f-bdd5-4a73-aaee-724b787deb03 resource = Database result = Ok(()) uri = /metrics/producers
26742024-09-05T00:47:39.580ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
26752024-09-05T00:47:39.582ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3761f44a-c557-4cd1-b991-b7d4d2b8c945", "date": "Thu, 05 Sep 2024 00:47:39 GMT"} })
26762024-09-05T00:47:39.582ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = 9c3576f2-3ad5-4e30-a194-86e7ba23efdd
26772024-09-05T00:47:39.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 71762 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39097 req_id = 37322e0f-bdd5-4a73-aaee-724b787deb03 response_code = 201 uri = /metrics/producers
26782024-09-05T00:47:40.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 07cbfed4-e05b-4a03-9746-cd923bab1e05 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26792024-09-05T00:47:40.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 07cbfed4-e05b-4a03-9746-cd923bab1e05 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26802024-09-05T00:47:40.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 07cbfed4-e05b-4a03-9746-cd923bab1e05 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26812024-09-05T00:47:40.618ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:52842
26822024-09-05T00:47:40.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52842 req_id = 47120d7b-99f8-40d6-83cd-4785a492efe9 roles = RoleSet { roles: {} } uri = /metrics/producers
26832024-09-05T00:47:40.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52842 req_id = 47120d7b-99f8-40d6-83cd-4785a492efe9 resource = Database result = Ok(()) uri = /metrics/producers
26842024-09-05T00:47:40.651ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
26852024-09-05T00:47:40.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52842 req_id = 47120d7b-99f8-40d6-83cd-4785a492efe9 roles = RoleSet { roles: {} } uri = /metrics/producers
26862024-09-05T00:47:40.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52842 req_id = 47120d7b-99f8-40d6-83cd-4785a492efe9 resource = Database result = Ok(()) uri = /metrics/producers
26872024-09-05T00:47:40.682ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
26882024-09-05T00:47:40.683ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "dfd3a907-a9c1-47e8-b893-237010bece7f", "date": "Thu, 05 Sep 2024 00:47:40 GMT"} })
26892024-09-05T00:47:40.683ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = 35429cca-496a-49ba-952c-5eef2f1c42c8
26902024-09-05T00:47:40.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 65845 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52842 req_id = 47120d7b-99f8-40d6-83cd-4785a492efe9 response_code = 201 uri = /metrics/producers
26912024-09-05T00:47:41.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4dd32799-dd09-41e1-9673-58383bc84230 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26922024-09-05T00:47:41.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4dd32799-dd09-41e1-9673-58383bc84230 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26932024-09-05T00:47:41.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2618 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4dd32799-dd09-41e1-9673-58383bc84230 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26942024-09-05T00:47:42.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 261e795c-7f85-4603-be6a-30de1a82137e roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26952024-09-05T00:47:42.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 261e795c-7f85-4603-be6a-30de1a82137e resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26962024-09-05T00:47:42.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 261e795c-7f85-4603-be6a-30de1a82137e response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26972024-09-05T00:47:43.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b55487a1-63d5-4c6b-bb15-98b7bdb44bb2 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26982024-09-05T00:47:43.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b55487a1-63d5-4c6b-bb15-98b7bdb44bb2 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
26992024-09-05T00:47:43.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b55487a1-63d5-4c6b-bb15-98b7bdb44bb2 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27002024-09-05T00:47:44.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fd4fdb18-4f81-41ed-a1f4-1687da614006 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27012024-09-05T00:47:44.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fd4fdb18-4f81-41ed-a1f4-1687da614006 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27022024-09-05T00:47:44.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2781 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fd4fdb18-4f81-41ed-a1f4-1687da614006 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27032024-09-05T00:47:44.955ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
27042024-09-05T00:47:44.955ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
27052024-09-05T00:47:44.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27062024-09-05T00:47:44.955ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27072024-09-05T00:47:44.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27082024-09-05T00:47:44.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27092024-09-05T00:47:44.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27102024-09-05T00:47:44.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27112024-09-05T00:47:44.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27122024-09-05T00:47:44.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27132024-09-05T00:47:44.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27142024-09-05T00:47:44.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27152024-09-05T00:47:44.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27162024-09-05T00:47:44.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
27172024-09-05T00:47:44.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27182024-09-05T00:47:44.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27192024-09-05T00:47:44.974ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
27202024-09-05T00:47:44.974ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.681021ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
27212024-09-05T00:47:44.983ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27222024-09-05T00:47:44.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27232024-09-05T00:47:45.009ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.190985ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27242024-09-05T00:47:45.094ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1599 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 8e61e09f-7794-4d46-8920-b6277971105b response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
27252024-09-05T00:47:45.095ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
27262024-09-05T00:47:45.095ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
27272024-09-05T00:47:45.126ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
27282024-09-05T00:47:45.126ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:38513
27292024-09-05T00:47:45.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38513 req_id = e9982dd0-b326-407c-9bef-b87e71838d21 roles = RoleSet { roles: {} } uri = /metrics/producers
27302024-09-05T00:47:45.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38513 req_id = e9982dd0-b326-407c-9bef-b87e71838d21 resource = Database result = Ok(()) uri = /metrics/producers
27312024-09-05T00:47:45.159ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
27322024-09-05T00:47:45.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38513 req_id = e9982dd0-b326-407c-9bef-b87e71838d21 roles = RoleSet { roles: {} } uri = /metrics/producers
27332024-09-05T00:47:45.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38513 req_id = e9982dd0-b326-407c-9bef-b87e71838d21 resource = Database result = Ok(()) uri = /metrics/producers
27342024-09-05T00:47:45.164ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
27352024-09-05T00:47:45.165ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8b9e5d01-e092-4b93-9d1f-bc8df20391f5", "date": "Thu, 05 Sep 2024 00:47:45 GMT"} })
27362024-09-05T00:47:45.165ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
27372024-09-05T00:47:45.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40059 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38513 req_id = e9982dd0-b326-407c-9bef-b87e71838d21 response_code = 201 uri = /metrics/producers
27382024-09-05T00:47:45.166ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "e9982dd0-b326-407c-9bef-b87e71838d21", "content-length": "41", "date": "Thu, 05 Sep 2024 00:47:45 GMT"} })
27392024-09-05T00:47:45.168ZDEBGnexus (producer-registration-task): registered with nexus successfully
27402024-09-05T00:47:45.168ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
27412024-09-05T00:47:45.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 35310302-3004-4cc5-918a-d0a7897e24ba roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27422024-09-05T00:47:45.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 35310302-3004-4cc5-918a-d0a7897e24ba resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27432024-09-05T00:47:45.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 35310302-3004-4cc5-918a-d0a7897e24ba response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27442024-09-05T00:47:46.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a572a338-e16a-4863-ade0-3b6d531c310d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27452024-09-05T00:47:46.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a572a338-e16a-4863-ade0-3b6d531c310d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27462024-09-05T00:47:46.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a572a338-e16a-4863-ade0-3b6d531c310d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27472024-09-05T00:47:47.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = abd27b70-e8c0-45c8-b1c9-ca286912b879 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27482024-09-05T00:47:47.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = abd27b70-e8c0-45c8-b1c9-ca286912b879 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27492024-09-05T00:47:47.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1822 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = abd27b70-e8c0-45c8-b1c9-ca286912b879 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27502024-09-05T00:47:48.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fdfe4866-7935-4e39-8ec6-6a97e6a696d6 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27512024-09-05T00:47:48.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fdfe4866-7935-4e39-8ec6-6a97e6a696d6 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27522024-09-05T00:47:48.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fdfe4866-7935-4e39-8ec6-6a97e6a696d6 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27532024-09-05T00:47:48.662ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:37928
27542024-09-05T00:47:48.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37928 req_id = e7203c56-965d-42f3-8756-2f74b5597870 roles = RoleSet { roles: {} } uri = /metrics/producers
27552024-09-05T00:47:48.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37928 req_id = e7203c56-965d-42f3-8756-2f74b5597870 resource = Database result = Ok(()) uri = /metrics/producers
27562024-09-05T00:47:48.694ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
27572024-09-05T00:47:48.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37928 req_id = e7203c56-965d-42f3-8756-2f74b5597870 roles = RoleSet { roles: {} } uri = /metrics/producers
27582024-09-05T00:47:48.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37928 req_id = e7203c56-965d-42f3-8756-2f74b5597870 resource = Database result = Ok(()) uri = /metrics/producers
27592024-09-05T00:47:48.701ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
27602024-09-05T00:47:48.702ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e509d5cf-4019-489a-ba7b-d0bb45257ea8", "date": "Thu, 05 Sep 2024 00:47:48 GMT"} })
27612024-09-05T00:47:48.702ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = 42b3183c-16e5-4e5a-9353-cb1f595a1c67
27622024-09-05T00:47:48.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 41332 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37928 req_id = e7203c56-965d-42f3-8756-2f74b5597870 response_code = 201 uri = /metrics/producers
27632024-09-05T00:47:49.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 481275ac-48c7-4772-a494-829950e8fbb4 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27642024-09-05T00:47:49.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 481275ac-48c7-4772-a494-829950e8fbb4 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27652024-09-05T00:47:49.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 481275ac-48c7-4772-a494-829950e8fbb4 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27662024-09-05T00:47:50.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4cd7d153-911e-4995-9ccf-378b8e519b40 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27672024-09-05T00:47:50.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4cd7d153-911e-4995-9ccf-378b8e519b40 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27682024-09-05T00:47:50.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4cd7d153-911e-4995-9ccf-378b8e519b40 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27692024-09-05T00:47:51.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9353dfaa-0d0d-45dd-a6f3-ab817d3b5686 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27702024-09-05T00:47:51.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9353dfaa-0d0d-45dd-a6f3-ab817d3b5686 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27712024-09-05T00:47:51.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2533 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9353dfaa-0d0d-45dd-a6f3-ab817d3b5686 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27722024-09-05T00:47:52.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2a31def4-e4ba-4f6b-927d-9426aa8fa63b roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27732024-09-05T00:47:52.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2a31def4-e4ba-4f6b-927d-9426aa8fa63b resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27742024-09-05T00:47:52.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2a31def4-e4ba-4f6b-927d-9426aa8fa63b response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27752024-09-05T00:47:53.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 09df464c-40e3-411e-ba7f-0ad96757622d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27762024-09-05T00:47:53.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 09df464c-40e3-411e-ba7f-0ad96757622d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27772024-09-05T00:47:53.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 09df464c-40e3-411e-ba7f-0ad96757622d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27782024-09-05T00:47:54.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5a9f7776-6071-434a-9e71-60a393641630 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27792024-09-05T00:47:54.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5a9f7776-6071-434a-9e71-60a393641630 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27802024-09-05T00:47:54.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2023 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5a9f7776-6071-434a-9e71-60a393641630 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
27812024-09-05T00:47:54.955ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
27822024-09-05T00:47:54.955ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
27832024-09-05T00:47:54.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27842024-09-05T00:47:54.955ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27852024-09-05T00:47:54.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27862024-09-05T00:47:54.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27872024-09-05T00:47:54.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27882024-09-05T00:47:54.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27892024-09-05T00:47:54.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27902024-09-05T00:47:54.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27912024-09-05T00:47:54.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27922024-09-05T00:47:54.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27932024-09-05T00:47:54.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27942024-09-05T00:47:54.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27952024-09-05T00:47:54.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27962024-09-05T00:47:54.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
27972024-09-05T00:47:54.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27982024-09-05T00:47:54.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27992024-09-05T00:47:54.972ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
28002024-09-05T00:47:54.972ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.628926ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
28012024-09-05T00:47:54.984ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.327484ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28022024-09-05T00:47:55.168ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1736 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 2cf04cdb-a4ab-4dd5-991a-ebc22e850098 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
28032024-09-05T00:47:55.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7af7baf9-5d05-467d-8597-7516dea6e350 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28042024-09-05T00:47:55.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7af7baf9-5d05-467d-8597-7516dea6e350 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28052024-09-05T00:47:55.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7af7baf9-5d05-467d-8597-7516dea6e350 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28062024-09-05T00:47:56.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e67a5102-dd9a-4916-919b-ea827880752b roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28072024-09-05T00:47:56.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e67a5102-dd9a-4916-919b-ea827880752b resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28082024-09-05T00:47:56.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e67a5102-dd9a-4916-919b-ea827880752b response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28092024-09-05T00:47:57.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9b197638-4ee6-4a9b-9d23-1e52de493fcc roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28102024-09-05T00:47:57.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9b197638-4ee6-4a9b-9d23-1e52de493fcc resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28112024-09-05T00:47:57.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9b197638-4ee6-4a9b-9d23-1e52de493fcc response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28122024-09-05T00:47:58.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 93d7c5cb-9354-42fe-b8df-e6ca954f5cf9 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28132024-09-05T00:47:58.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 93d7c5cb-9354-42fe-b8df-e6ca954f5cf9 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28142024-09-05T00:47:58.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2878 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 93d7c5cb-9354-42fe-b8df-e6ca954f5cf9 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28152024-09-05T00:47:59.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 08105ae3-9aa1-434a-b2f0-e31b4981ef25 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28162024-09-05T00:47:59.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 08105ae3-9aa1-434a-b2f0-e31b4981ef25 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28172024-09-05T00:47:59.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1771 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 08105ae3-9aa1-434a-b2f0-e31b4981ef25 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28182024-09-05T00:48:00.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 713d62be-91c9-4505-8f3e-19ffd29c886b roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28192024-09-05T00:48:00.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 713d62be-91c9-4505-8f3e-19ffd29c886b resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28202024-09-05T00:48:00.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 713d62be-91c9-4505-8f3e-19ffd29c886b response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28212024-09-05T00:48:01.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b3a95e47-f0c7-41ac-9672-3c192b39be54 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28222024-09-05T00:48:01.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b3a95e47-f0c7-41ac-9672-3c192b39be54 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28232024-09-05T00:48:01.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b3a95e47-f0c7-41ac-9672-3c192b39be54 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28242024-09-05T00:48:02.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5598ee52-b6d5-4d05-a407-34b66c0b899d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28252024-09-05T00:48:02.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5598ee52-b6d5-4d05-a407-34b66c0b899d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28262024-09-05T00:48:02.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5598ee52-b6d5-4d05-a407-34b66c0b899d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28272024-09-05T00:48:03.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0f32f8f9-fe06-48b0-97b2-c47eb8d45803 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28282024-09-05T00:48:03.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0f32f8f9-fe06-48b0-97b2-c47eb8d45803 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28292024-09-05T00:48:03.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2481 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0f32f8f9-fe06-48b0-97b2-c47eb8d45803 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28302024-09-05T00:48:04.953ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
28312024-09-05T00:48:04.953ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28322024-09-05T00:48:04.953ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
28332024-09-05T00:48:04.953ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28342024-09-05T00:48:04.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c75020c9-888d-4f66-87b0-d1ac3bb8d482 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28352024-09-05T00:48:04.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28362024-09-05T00:48:04.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28372024-09-05T00:48:04.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c75020c9-888d-4f66-87b0-d1ac3bb8d482 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28382024-09-05T00:48:04.954ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
28392024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
28402024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
28412024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
28422024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28432024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28442024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28452024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
28462024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
28472024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28482024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28492024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
28502024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
28512024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28522024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
28532024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28542024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28552024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
28562024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28572024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
28582024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28592024-09-05T00:48:04.955ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28602024-09-05T00:48:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28612024-09-05T00:48:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28622024-09-05T00:48:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28632024-09-05T00:48:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28642024-09-05T00:48:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28652024-09-05T00:48:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28662024-09-05T00:48:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28672024-09-05T00:48:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28682024-09-05T00:48:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28692024-09-05T00:48:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28702024-09-05T00:48:04.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3897 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c75020c9-888d-4f66-87b0-d1ac3bb8d482 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
28712024-09-05T00:48:04.957ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3747, tv_nsec: 23890261 } })
28722024-09-05T00:48:04.957ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3747, tv_nsec: 24095514 } })
28732024-09-05T00:48:04.958ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
28742024-09-05T00:48:04.958ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28752024-09-05T00:48:04.958ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28762024-09-05T00:48:04.958ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28772024-09-05T00:48:04.959ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.585962ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
28782024-09-05T00:48:04.959ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
28792024-09-05T00:48:04.959ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
28802024-09-05T00:48:04.959ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
28812024-09-05T00:48:04.959ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28822024-09-05T00:48:04.959ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28832024-09-05T00:48:04.959ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
28842024-09-05T00:48:04.959ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28852024-09-05T00:48:04.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28862024-09-05T00:48:04.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28872024-09-05T00:48:04.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
28882024-09-05T00:48:04.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28892024-09-05T00:48:04.959ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
28902024-09-05T00:48:04.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
28912024-09-05T00:48:04.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28922024-09-05T00:48:04.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
28932024-09-05T00:48:04.961ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28942024-09-05T00:48:04.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28952024-09-05T00:48:04.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28962024-09-05T00:48:04.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28972024-09-05T00:48:04.962ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28982024-09-05T00:48:04.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28992024-09-05T00:48:04.962ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29002024-09-05T00:48:04.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29012024-09-05T00:48:04.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29022024-09-05T00:48:04.963ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29032024-09-05T00:48:04.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29042024-09-05T00:48:04.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29052024-09-05T00:48:04.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29062024-09-05T00:48:04.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29072024-09-05T00:48:04.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29082024-09-05T00:48:04.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29092024-09-05T00:48:04.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29102024-09-05T00:48:04.973ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3747, tv_nsec: 39763343 } })
29112024-09-05T00:48:04.974ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
29122024-09-05T00:48:04.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29132024-09-05T00:48:04.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29142024-09-05T00:48:04.975ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29152024-09-05T00:48:04.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29162024-09-05T00:48:04.975ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29172024-09-05T00:48:04.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29182024-09-05T00:48:04.977ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29192024-09-05T00:48:04.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29202024-09-05T00:48:04.979ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29212024-09-05T00:48:04.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29222024-09-05T00:48:04.992ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
29232024-09-05T00:48:04.992ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
29242024-09-05T00:48:04.993ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29252024-09-05T00:48:04.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29262024-09-05T00:48:05.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29272024-09-05T00:48:05.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29282024-09-05T00:48:05.005ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29292024-09-05T00:48:05.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29302024-09-05T00:48:05.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29312024-09-05T00:48:05.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29322024-09-05T00:48:05.007ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29332024-09-05T00:48:05.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29342024-09-05T00:48:05.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.259479ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
29352024-09-05T00:48:05.008ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29362024-09-05T00:48:05.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a014d257-275c-449e-a4f4-aef00eab141c, lookup_type: ById(a014d257-275c-449e-a4f4-aef00eab141c) } result = Ok(())
29372024-09-05T00:48:05.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29382024-09-05T00:48:05.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29392024-09-05T00:48:05.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29402024-09-05T00:48:05.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29412024-09-05T00:48:05.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29422024-09-05T00:48:05.013ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 57.464303ms iteration = 12 status = 0
29432024-09-05T00:48:05.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29442024-09-05T00:48:05.013ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29452024-09-05T00:48:05.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29462024-09-05T00:48:05.015ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29472024-09-05T00:48:05.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29482024-09-05T00:48:05.017ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.380853ms iteration = 12 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
29492024-09-05T00:48:05.023ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
29502024-09-05T00:48:05.023ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29512024-09-05T00:48:05.024ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f80d005b-b709-4585-b886-c6b63d527f30", "content-length": "26", "date": "Thu, 05 Sep 2024 00:48:04 GMT"} })
29522024-09-05T00:48:05.024ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29532024-09-05T00:48:05.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29542024-09-05T00:48:05.025ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29552024-09-05T00:48:05.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
29562024-09-05T00:48:05.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29572024-09-05T00:48:05.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29582024-09-05T00:48:05.028ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
29592024-09-05T00:48:05.028ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29602024-09-05T00:48:05.029ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d14429c4-3fea-43b2-876b-0db767b6ae99", "content-length": "26", "date": "Thu, 05 Sep 2024 00:48:04 GMT"} })
29612024-09-05T00:48:05.029ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29622024-09-05T00:48:05.031ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29632024-09-05T00:48:05.031ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
29642024-09-05T00:48:05.031ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
29652024-09-05T00:48:05.031ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 76.077015ms iteration = 12 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
29662024-09-05T00:48:05.038ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.660932ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29672024-09-05T00:48:05.039ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
29682024-09-05T00:48:05.039ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.081277ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
29692024-09-05T00:48:05.041ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.495959ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
29702024-09-05T00:48:05.042ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29712024-09-05T00:48:05.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29722024-09-05T00:48:05.044ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
29732024-09-05T00:48:05.044ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 85.868378ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
29742024-09-05T00:48:05.045ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29752024-09-05T00:48:05.045ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.743488ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29762024-09-05T00:48:05.055ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b zone_address = fd00:1122:3344:101::2
29772024-09-05T00:48:05.055ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29782024-09-05T00:48:05.056ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0322752b-973b-4f7c-bb66-33238f4da444", "content-length": "26", "date": "Thu, 05 Sep 2024 00:48:04 GMT"} })
29792024-09-05T00:48:05.056ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29802024-09-05T00:48:05.057ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
29812024-09-05T00:48:05.072ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 117.000273ms iteration = 15 status = {"physical_disks_added":0}
29822024-09-05T00:48:05.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29832024-09-05T00:48:05.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29842024-09-05T00:48:05.137ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 184.190178ms iteration = 12 status = {}
29852024-09-05T00:48:05.168ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = f2ad5e29-d9fc-4e56-a799-069d19ed695a response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
29862024-09-05T00:48:05.183ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
29872024-09-05T00:48:05.183ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "553dc6bb-d70f-4036-8985-e3d07a2ea06e", "content-length": "1", "date": "Thu, 05 Sep 2024 00:48:04 GMT"} })
29882024-09-05T00:48:05.186ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29892024-09-05T00:48:05.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29902024-09-05T00:48:05.201ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29912024-09-05T00:48:05.201ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b79170ed-b675-471f-a6e8-c1e9fef78b21", "content-length": "372", "date": "Thu, 05 Sep 2024 00:48:04 GMT"} })
29922024-09-05T00:48:05.201ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29932024-09-05T00:48:05.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29942024-09-05T00:48:05.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29952024-09-05T00:48:05.203ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 250.380506ms iteration = 12 status = null
29962024-09-05T00:48:05.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29972024-09-05T00:48:05.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29982024-09-05T00:48:05.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29992024-09-05T00:48:05.209ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30002024-09-05T00:48:05.209ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30012024-09-05T00:48:05.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30022024-09-05T00:48:05.209ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "00b653d8-f4d9-4b4e-ab23-625f241de9b7", "date": "Thu, 05 Sep 2024 00:48:04 GMT"} })
30032024-09-05T00:48:05.210ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30042024-09-05T00:48:05.211ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 256.064158ms iteration = 13 status = {}
30052024-09-05T00:48:05.212ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30062024-09-05T00:48:05.212ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30072024-09-05T00:48:05.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30082024-09-05T00:48:05.213ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30092024-09-05T00:48:05.215ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30102024-09-05T00:48:05.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30112024-09-05T00:48:05.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30122024-09-05T00:48:05.267ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30132024-09-05T00:48:05.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30142024-09-05T00:48:05.268ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 3013d0b1-47fb-4df1-97e5-7049d1043033, rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c4762fe-488f-4054-979a-f54d371ea654) } rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
30152024-09-05T00:48:05.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30162024-09-05T00:48:05.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30172024-09-05T00:48:05.270ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30182024-09-05T00:48:05.271ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "330d9eb9-4064-483f-9376-56b3bc0dc8c5", "content-length": "691", "date": "Thu, 05 Sep 2024 00:48:04 GMT"} })
30192024-09-05T00:48:05.271ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
30202024-09-05T00:48:05.271ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
30212024-09-05T00:48:05.271ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
30222024-09-05T00:48:05.272ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 316.901551ms iteration = 12 status = {}
30232024-09-05T00:48:05.277ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
30242024-09-05T00:48:05.278ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "af76eef0-c7ab-4366-8c5b-675c01e649c0", "content-length": "121", "date": "Thu, 05 Sep 2024 00:48:04 GMT"} })
30252024-09-05T00:48:05.278ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
30262024-09-05T00:48:05.278ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c4762fe-488f-4054-979a-f54d371ea654
30272024-09-05T00:48:05.278ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30282024-09-05T00:48:05.278ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30292024-09-05T00:48:05.278ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
30302024-09-05T00:48:05.278ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
30312024-09-05T00:48:05.278ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
30322024-09-05T00:48:05.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30332024-09-05T00:48:05.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30342024-09-05T00:48:05.279ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
30352024-09-05T00:48:05.279ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "00993ffa-3e2a-42da-8769-0b0c99e6488c", "content-length": "2", "date": "Thu, 05 Sep 2024 00:48:04 GMT"} })
30362024-09-05T00:48:05.279ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
30372024-09-05T00:48:05.279ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fa1c3770-1c54-47b3-954a-bcbc3860c342", "content-length": "51", "date": "Thu, 05 Sep 2024 00:48:04 GMT"} })
30382024-09-05T00:48:05.279ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
30392024-09-05T00:48:05.279ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
30402024-09-05T00:48:05.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 9b0aea7a-add3-4110-a239-9bc81707466e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
30412024-09-05T00:48:05.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 9b0aea7a-add3-4110-a239-9bc81707466e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
30422024-09-05T00:48:05.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 9b0aea7a-add3-4110-a239-9bc81707466e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
30432024-09-05T00:48:05.374ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3fb4eb42-ff8f-4aaa-ad31-96d1a2a461bf", "date": "Thu, 05 Sep 2024 00:48:04 GMT"} })
30442024-09-05T00:48:05.374ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch = Switch0
30452024-09-05T00:48:05.374ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
30462024-09-05T00:48:05.375ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b74872bb-fada-40e2-9bfb-eec3ef13314d", "content-length": "667", "date": "Thu, 05 Sep 2024 00:48:04 GMT"} })
30472024-09-05T00:48:05.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30482024-09-05T00:48:05.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30492024-09-05T00:48:05.378ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30502024-09-05T00:48:05.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30512024-09-05T00:48:05.382ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30522024-09-05T00:48:05.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30532024-09-05T00:48:05.384ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30542024-09-05T00:48:05.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30552024-09-05T00:48:05.392ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 436.553102ms iteration = 12 status = {}
30562024-09-05T00:48:05.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d870d68e-925d-45c3-80f3-48eb4dd87041 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30572024-09-05T00:48:05.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d870d68e-925d-45c3-80f3-48eb4dd87041 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30582024-09-05T00:48:05.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d870d68e-925d-45c3-80f3-48eb4dd87041 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30592024-09-05T00:48:07.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b4595699-4ceb-4398-97b8-02d971f5d485 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30602024-09-05T00:48:07.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b4595699-4ceb-4398-97b8-02d971f5d485 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30612024-09-05T00:48:07.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b4595699-4ceb-4398-97b8-02d971f5d485 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30622024-09-05T00:48:08.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 289ef52f-8320-47f7-98c1-4e70a286ab0b roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30632024-09-05T00:48:08.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 289ef52f-8320-47f7-98c1-4e70a286ab0b resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30642024-09-05T00:48:08.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 289ef52f-8320-47f7-98c1-4e70a286ab0b response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30652024-09-05T00:48:09.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6d1f7413-d09f-4d22-ae39-6e02b0eecd78 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30662024-09-05T00:48:09.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6d1f7413-d09f-4d22-ae39-6e02b0eecd78 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30672024-09-05T00:48:09.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2611 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6d1f7413-d09f-4d22-ae39-6e02b0eecd78 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30682024-09-05T00:48:10.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 19faae5f-7b0d-4caf-bb90-a3ab97d3a9f4 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30692024-09-05T00:48:10.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 19faae5f-7b0d-4caf-bb90-a3ab97d3a9f4 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30702024-09-05T00:48:10.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 19faae5f-7b0d-4caf-bb90-a3ab97d3a9f4 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30712024-09-05T00:48:10.381ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:47002
30722024-09-05T00:48:10.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47002 req_id = 418b4e3f-447e-446f-a67d-2f433e656eff roles = RoleSet { roles: {} } uri = /metrics/producers
30732024-09-05T00:48:10.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47002 req_id = 418b4e3f-447e-446f-a67d-2f433e656eff resource = Database result = Ok(()) uri = /metrics/producers
30742024-09-05T00:48:10.415ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
30752024-09-05T00:48:10.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47002 req_id = 418b4e3f-447e-446f-a67d-2f433e656eff roles = RoleSet { roles: {} } uri = /metrics/producers
30762024-09-05T00:48:10.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47002 req_id = 418b4e3f-447e-446f-a67d-2f433e656eff resource = Database result = Ok(()) uri = /metrics/producers
30772024-09-05T00:48:10.449ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
30782024-09-05T00:48:10.449ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7b377c06-94cc-4333-9bfa-e977efe2f6b4", "date": "Thu, 05 Sep 2024 00:48:10 GMT"} })
30792024-09-05T00:48:10.449ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = a014d257-275c-449e-a4f4-aef00eab141c
30802024-09-05T00:48:10.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 70497 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47002 req_id = 418b4e3f-447e-446f-a67d-2f433e656eff response_code = 201 uri = /metrics/producers
30812024-09-05T00:48:11.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f7296ad3-014a-4c3a-9a7b-4e4fe76f63c5 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30822024-09-05T00:48:11.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f7296ad3-014a-4c3a-9a7b-4e4fe76f63c5 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30832024-09-05T00:48:11.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f7296ad3-014a-4c3a-9a7b-4e4fe76f63c5 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30842024-09-05T00:48:11.690ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:39885
30852024-09-05T00:48:11.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39885 req_id = 933dfaf1-c961-4b0d-aa74-27cbb01d08ac roles = RoleSet { roles: {} } uri = /metrics/producers
30862024-09-05T00:48:11.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39885 req_id = 933dfaf1-c961-4b0d-aa74-27cbb01d08ac resource = Database result = Ok(()) uri = /metrics/producers
30872024-09-05T00:48:11.723ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
30882024-09-05T00:48:11.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39885 req_id = 933dfaf1-c961-4b0d-aa74-27cbb01d08ac roles = RoleSet { roles: {} } uri = /metrics/producers
30892024-09-05T00:48:11.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39885 req_id = 933dfaf1-c961-4b0d-aa74-27cbb01d08ac resource = Database result = Ok(()) uri = /metrics/producers
30902024-09-05T00:48:11.759ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
30912024-09-05T00:48:11.760ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f07f9eb0-b288-455a-b69f-10aa8f767466", "date": "Thu, 05 Sep 2024 00:48:11 GMT"} })
30922024-09-05T00:48:11.760ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = 7133bf3b-5b99-4a6e-bebd-7577dd2d3d94
30932024-09-05T00:48:11.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 71669 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39885 req_id = 933dfaf1-c961-4b0d-aa74-27cbb01d08ac response_code = 201 uri = /metrics/producers
30942024-09-05T00:48:12.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 99267576-472b-4490-a8ff-11282c1aa982 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30952024-09-05T00:48:12.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 99267576-472b-4490-a8ff-11282c1aa982 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30962024-09-05T00:48:12.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1889 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 99267576-472b-4490-a8ff-11282c1aa982 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30972024-09-05T00:48:13.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 35b27833-17d5-46b5-a65e-2216922c035c roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30982024-09-05T00:48:13.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 35b27833-17d5-46b5-a65e-2216922c035c resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
30992024-09-05T00:48:13.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 35b27833-17d5-46b5-a65e-2216922c035c response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31002024-09-05T00:48:14.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b790f941-3069-424c-b5d6-8c9416e71a87 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31012024-09-05T00:48:14.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b790f941-3069-424c-b5d6-8c9416e71a87 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31022024-09-05T00:48:14.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2389 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b790f941-3069-424c-b5d6-8c9416e71a87 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31032024-09-05T00:48:14.955ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
31042024-09-05T00:48:14.955ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
31052024-09-05T00:48:14.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31062024-09-05T00:48:14.955ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31072024-09-05T00:48:14.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31082024-09-05T00:48:14.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31092024-09-05T00:48:14.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31102024-09-05T00:48:14.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31112024-09-05T00:48:14.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31122024-09-05T00:48:14.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31132024-09-05T00:48:14.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31142024-09-05T00:48:14.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31152024-09-05T00:48:14.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31162024-09-05T00:48:14.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
31172024-09-05T00:48:14.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31182024-09-05T00:48:14.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31192024-09-05T00:48:14.974ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
31202024-09-05T00:48:14.974ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.937187ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
31212024-09-05T00:48:14.983ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31222024-09-05T00:48:14.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31232024-09-05T00:48:15.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.391575ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31242024-09-05T00:48:15.169ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 35c2e30f-bc06-4c28-8e30-634e8bb58f16 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
31252024-09-05T00:48:15.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 935c2a22-b21a-4543-abdc-51d62b6c7bd1 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31262024-09-05T00:48:15.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 935c2a22-b21a-4543-abdc-51d62b6c7bd1 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31272024-09-05T00:48:15.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 935c2a22-b21a-4543-abdc-51d62b6c7bd1 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31282024-09-05T00:48:16.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a4e2ab64-e7e0-4db6-b40c-5239fdeb1f43 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31292024-09-05T00:48:16.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a4e2ab64-e7e0-4db6-b40c-5239fdeb1f43 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31302024-09-05T00:48:16.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a4e2ab64-e7e0-4db6-b40c-5239fdeb1f43 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31312024-09-05T00:48:17.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d437e530-a79d-4ace-9b17-ad8e89a1800a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31322024-09-05T00:48:17.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d437e530-a79d-4ace-9b17-ad8e89a1800a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31332024-09-05T00:48:17.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2291 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d437e530-a79d-4ace-9b17-ad8e89a1800a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31342024-09-05T00:48:18.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f6a98d56-f95a-4f4e-a261-1a7667a4c58f roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31352024-09-05T00:48:18.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f6a98d56-f95a-4f4e-a261-1a7667a4c58f resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31362024-09-05T00:48:18.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f6a98d56-f95a-4f4e-a261-1a7667a4c58f response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31372024-09-05T00:48:19.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 34b195f8-896d-404d-be7b-09c47c171381 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31382024-09-05T00:48:19.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 34b195f8-896d-404d-be7b-09c47c171381 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31392024-09-05T00:48:19.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 34b195f8-896d-404d-be7b-09c47c171381 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31402024-09-05T00:48:20.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = df083fcd-b57e-4b65-ad32-3c957f24554e roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31412024-09-05T00:48:20.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = df083fcd-b57e-4b65-ad32-3c957f24554e resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31422024-09-05T00:48:20.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = df083fcd-b57e-4b65-ad32-3c957f24554e response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31432024-09-05T00:48:21.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 92045a34-e6ed-4e67-9ba9-95208fb51d4d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31442024-09-05T00:48:21.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 92045a34-e6ed-4e67-9ba9-95208fb51d4d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31452024-09-05T00:48:21.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 92045a34-e6ed-4e67-9ba9-95208fb51d4d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31462024-09-05T00:48:22.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8bd6e0a6-614d-44a8-8825-3f8fe5ec4534 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31472024-09-05T00:48:22.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8bd6e0a6-614d-44a8-8825-3f8fe5ec4534 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31482024-09-05T00:48:22.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 5204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8bd6e0a6-614d-44a8-8825-3f8fe5ec4534 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31492024-09-05T00:48:23.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 419f4c74-6cb5-4b01-bd27-9257191d35d5 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31502024-09-05T00:48:23.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 419f4c74-6cb5-4b01-bd27-9257191d35d5 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31512024-09-05T00:48:23.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 419f4c74-6cb5-4b01-bd27-9257191d35d5 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31522024-09-05T00:48:24.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d3f8cfe0-0dba-4869-9400-d223978f9a40 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31532024-09-05T00:48:24.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d3f8cfe0-0dba-4869-9400-d223978f9a40 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31542024-09-05T00:48:24.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d3f8cfe0-0dba-4869-9400-d223978f9a40 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31552024-09-05T00:48:24.955ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
31562024-09-05T00:48:24.955ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31572024-09-05T00:48:24.955ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
31582024-09-05T00:48:24.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31592024-09-05T00:48:24.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31602024-09-05T00:48:24.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31612024-09-05T00:48:24.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31622024-09-05T00:48:24.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31632024-09-05T00:48:24.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31642024-09-05T00:48:24.958ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.241968ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31652024-09-05T00:48:24.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31662024-09-05T00:48:24.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31672024-09-05T00:48:24.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31682024-09-05T00:48:24.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31692024-09-05T00:48:24.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31702024-09-05T00:48:24.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31712024-09-05T00:48:24.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
31722024-09-05T00:48:24.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31732024-09-05T00:48:24.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31742024-09-05T00:48:24.970ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
31752024-09-05T00:48:24.970ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.270452ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
31762024-09-05T00:48:25.168ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1292 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 42fadc6f-e31d-4173-8eef-258ce7b72093 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
31772024-09-05T00:48:25.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3cbfdd8b-7139-4c5a-9c78-901687e52ad1 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31782024-09-05T00:48:25.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3cbfdd8b-7139-4c5a-9c78-901687e52ad1 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31792024-09-05T00:48:25.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1697 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3cbfdd8b-7139-4c5a-9c78-901687e52ad1 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31802024-09-05T00:48:26.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d20066eb-d3e2-49c9-b729-e71647d15ff3 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31812024-09-05T00:48:26.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d20066eb-d3e2-49c9-b729-e71647d15ff3 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31822024-09-05T00:48:26.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2265 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d20066eb-d3e2-49c9-b729-e71647d15ff3 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31832024-09-05T00:48:27.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b21188d0-55b3-4f24-baf3-25d2ac57d372 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31842024-09-05T00:48:27.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b21188d0-55b3-4f24-baf3-25d2ac57d372 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31852024-09-05T00:48:27.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b21188d0-55b3-4f24-baf3-25d2ac57d372 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31862024-09-05T00:48:28.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7ce5fa59-9b33-43cf-a92a-69027351cdd4 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31872024-09-05T00:48:28.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7ce5fa59-9b33-43cf-a92a-69027351cdd4 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31882024-09-05T00:48:28.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7ce5fa59-9b33-43cf-a92a-69027351cdd4 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31892024-09-05T00:48:29.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a592e87e-09af-4a2c-8605-518563b6c33f roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31902024-09-05T00:48:29.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a592e87e-09af-4a2c-8605-518563b6c33f resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31912024-09-05T00:48:29.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a592e87e-09af-4a2c-8605-518563b6c33f response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31922024-09-05T00:48:30.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 08d66c05-e1e4-4d13-a2c4-8e13347e1cca roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31932024-09-05T00:48:30.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 08d66c05-e1e4-4d13-a2c4-8e13347e1cca resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31942024-09-05T00:48:30.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2903 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 08d66c05-e1e4-4d13-a2c4-8e13347e1cca response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31952024-09-05T00:48:31.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1180f5bb-e7c3-4daf-86f7-16365b3b80e7 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31962024-09-05T00:48:31.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1180f5bb-e7c3-4daf-86f7-16365b3b80e7 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31972024-09-05T00:48:31.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1180f5bb-e7c3-4daf-86f7-16365b3b80e7 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31982024-09-05T00:48:32.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 18c6f9a7-4849-4bf3-8b45-da31c4fc050e roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
31992024-09-05T00:48:32.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 18c6f9a7-4849-4bf3-8b45-da31c4fc050e resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
32002024-09-05T00:48:32.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2614 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 18c6f9a7-4849-4bf3-8b45-da31c4fc050e response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
32012024-09-05T00:48:33.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bb37e208-c91a-46d9-be34-44934495bc94 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
32022024-09-05T00:48:33.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bb37e208-c91a-46d9-be34-44934495bc94 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
32032024-09-05T00:48:33.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bb37e208-c91a-46d9-be34-44934495bc94 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
32042024-09-05T00:48:34.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6c2d20f9-f87a-4c1c-87da-464c8ac0d70d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
32052024-09-05T00:48:34.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6c2d20f9-f87a-4c1c-87da-464c8ac0d70d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
32062024-09-05T00:48:34.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6c2d20f9-f87a-4c1c-87da-464c8ac0d70d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
32072024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
32082024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
32092024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32102024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32112024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
32122024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
32132024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
32142024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
32152024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32162024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
32172024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
32182024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
32192024-09-05T00:48:34.953ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-05 00:38:34.953722439 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
32202024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
32212024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
32222024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32232024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
32242024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
32252024-09-05T00:48:34.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32262024-09-05T00:48:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
32272024-09-05T00:48:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32282024-09-05T00:48:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32292024-09-05T00:48:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32302024-09-05T00:48:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
32312024-09-05T00:48:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32322024-09-05T00:48:34.954ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("145d6d08-bb1c-4557-af3d-b3b8e647b114.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4aa18504-a7e8-4aa1-94fe-a65abab62a4b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("4aa18504-a7e8-4aa1-94fe-a65abab62a4b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3777, tv_nsec: 20212893 } })
32332024-09-05T00:48:34.954ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
32342024-09-05T00:48:34.955ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c51ae87-cbaf-4403-8e7a-91ae1f6a480f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89145bfe-85a8-47ae-9826-e73f4757fe92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("972980d1-78ce-4b3e-8b23-36e1a0e30ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("972980d1-78ce-4b3e-8b23-36e1a0e30ffb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 3777, tv_nsec: 21262422 } })
32352024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
32362024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
32372024-09-05T00:48:34.955ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59
32382024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32392024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
32402024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.001\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59"}
32412024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
32422024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32432024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
32442024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
32452024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32462024-09-05T00:48:34.955ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
32472024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32482024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
32492024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32502024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32512024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
32522024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32532024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
32542024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32552024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
32562024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
32572024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32582024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
32592024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32602024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
32612024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32622024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
32632024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32642024-09-05T00:48:34.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32652024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32662024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32672024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32682024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32692024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32702024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32712024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32722024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32732024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32742024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32752024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32762024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32772024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32782024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32792024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32802024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32812024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32822024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32832024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32842024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32852024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32862024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
32872024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.160926ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
32882024-09-05T00:48:34.956ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32892024-09-05T00:48:34.957ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32902024-09-05T00:48:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32912024-09-05T00:48:34.958ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-05 00:38:34.953722439 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
32922024-09-05T00:48:34.958ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.100041ms iteration = 7 status = {"expiration":"2024-09-05T00:38:34.953722439Z","pruned":[]}
32932024-09-05T00:48:34.959ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
32942024-09-05T00:48:34.959ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.475778ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
32952024-09-05T00:48:34.959ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3777, tv_nsec: 25110130 } })
32962024-09-05T00:48:34.959ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3777, tv_nsec: 25119410 } })
32972024-09-05T00:48:34.959ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32982024-09-05T00:48:34.959ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32992024-09-05T00:48:34.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33002024-09-05T00:48:34.960ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
33012024-09-05T00:48:34.960ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
33022024-09-05T00:48:34.960ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33032024-09-05T00:48:34.960ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
33042024-09-05T00:48:34.960ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
33052024-09-05T00:48:34.960ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
33062024-09-05T00:48:34.960ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
33072024-09-05T00:48:34.960ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
33082024-09-05T00:48:34.960ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33092024-09-05T00:48:34.960ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
33102024-09-05T00:48:34.960ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
33112024-09-05T00:48:34.960ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
33122024-09-05T00:48:34.960ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
33132024-09-05T00:48:34.960ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
33142024-09-05T00:48:34.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33152024-09-05T00:48:34.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33162024-09-05T00:48:34.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
33172024-09-05T00:48:34.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33182024-09-05T00:48:34.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
33192024-09-05T00:48:34.962ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33202024-09-05T00:48:34.962ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33212024-09-05T00:48:34.963ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33222024-09-05T00:48:34.963ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.943019ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33232024-09-05T00:48:34.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33242024-09-05T00:48:34.965ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33252024-09-05T00:48:34.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
33262024-09-05T00:48:34.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33272024-09-05T00:48:34.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33282024-09-05T00:48:34.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33292024-09-05T00:48:34.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33302024-09-05T00:48:34.965ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33312024-09-05T00:48:34.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33322024-09-05T00:48:34.967ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33332024-09-05T00:48:34.968ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
33342024-09-05T00:48:34.968ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33352024-09-05T00:48:34.968ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33362024-09-05T00:48:34.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33372024-09-05T00:48:34.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33382024-09-05T00:48:34.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33392024-09-05T00:48:34.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33402024-09-05T00:48:34.970ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33412024-09-05T00:48:34.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33422024-09-05T00:48:34.971ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33432024-09-05T00:48:34.971ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33442024-09-05T00:48:34.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33452024-09-05T00:48:34.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
33462024-09-05T00:48:34.971ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33472024-09-05T00:48:34.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33482024-09-05T00:48:34.972ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33492024-09-05T00:48:34.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33502024-09-05T00:48:34.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33512024-09-05T00:48:34.975ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33522024-09-05T00:48:34.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33532024-09-05T00:48:34.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33542024-09-05T00:48:34.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33552024-09-05T00:48:34.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33562024-09-05T00:48:34.980ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33572024-09-05T00:48:34.980ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33582024-09-05T00:48:34.980ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33592024-09-05T00:48:34.980ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
33602024-09-05T00:48:34.980ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33612024-09-05T00:48:34.980ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33622024-09-05T00:48:34.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33632024-09-05T00:48:34.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33642024-09-05T00:48:34.982ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33652024-09-05T00:48:34.982ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33662024-09-05T00:48:34.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33672024-09-05T00:48:34.984ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 24.71331ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
33682024-09-05T00:48:34.985ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 25.369661ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
33692024-09-05T00:48:34.986ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3777, tv_nsec: 52437917 } })
33702024-09-05T00:48:34.986ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33712024-09-05T00:48:34.986ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
33722024-09-05T00:48:34.986ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
33732024-09-05T00:48:34.986ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 31.198736ms iteration = 13 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
33742024-09-05T00:48:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33752024-09-05T00:48:34.987ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33762024-09-05T00:48:34.987ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33772024-09-05T00:48:34.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33782024-09-05T00:48:34.988ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
33792024-09-05T00:48:34.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33802024-09-05T00:48:34.988ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33812024-09-05T00:48:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33822024-09-05T00:48:34.989ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33832024-09-05T00:48:34.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33842024-09-05T00:48:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33852024-09-05T00:48:34.991ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33862024-09-05T00:48:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33872024-09-05T00:48:34.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33882024-09-05T00:48:34.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33892024-09-05T00:48:34.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
33902024-09-05T00:48:34.994ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33912024-09-05T00:48:34.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33922024-09-05T00:48:34.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33932024-09-05T00:48:34.997ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33942024-09-05T00:48:34.997ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33952024-09-05T00:48:34.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33962024-09-05T00:48:34.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
33972024-09-05T00:48:34.999ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33982024-09-05T00:48:34.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33992024-09-05T00:48:35.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
34002024-09-05T00:48:35.000ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34012024-09-05T00:48:35.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34022024-09-05T00:48:35.002ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34032024-09-05T00:48:35.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34042024-09-05T00:48:35.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34052024-09-05T00:48:35.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34062024-09-05T00:48:35.008ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34072024-09-05T00:48:35.010ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
34082024-09-05T00:48:35.010ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.05844ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
34092024-09-05T00:48:35.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34102024-09-05T00:48:35.011ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34112024-09-05T00:48:35.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34122024-09-05T00:48:35.014ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34132024-09-05T00:48:35.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34142024-09-05T00:48:35.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34152024-09-05T00:48:35.016ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34162024-09-05T00:48:35.016ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
34172024-09-05T00:48:35.016ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.681971ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
34182024-09-05T00:48:35.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34192024-09-05T00:48:35.017ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
34202024-09-05T00:48:35.017ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
34212024-09-05T00:48:35.017ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.137447ms iteration = 7 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
34222024-09-05T00:48:35.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34232024-09-05T00:48:35.017ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34242024-09-05T00:48:35.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34252024-09-05T00:48:35.018ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34262024-09-05T00:48:35.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34272024-09-05T00:48:35.019ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 63.484601ms iteration = 4 status = {"nsuccess":5}
34282024-09-05T00:48:35.021ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
34292024-09-05T00:48:35.021ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
34302024-09-05T00:48:35.021ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
34312024-09-05T00:48:35.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34322024-09-05T00:48:35.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34332024-09-05T00:48:35.023ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34342024-09-05T00:48:35.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34352024-09-05T00:48:35.026ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34362024-09-05T00:48:35.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34372024-09-05T00:48:35.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34382024-09-05T00:48:35.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34392024-09-05T00:48:35.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34402024-09-05T00:48:35.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34412024-09-05T00:48:35.033ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34422024-09-05T00:48:35.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34432024-09-05T00:48:35.035ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34442024-09-05T00:48:35.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34452024-09-05T00:48:35.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 75.352542ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
34462024-09-05T00:48:35.036ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34472024-09-05T00:48:35.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34482024-09-05T00:48:35.036ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34492024-09-05T00:48:35.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.670464ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34502024-09-05T00:48:35.038ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34512024-09-05T00:48:35.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34522024-09-05T00:48:35.039ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34532024-09-05T00:48:35.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34542024-09-05T00:48:35.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a014d257-275c-449e-a4f4-aef00eab141c, lookup_type: ById(a014d257-275c-449e-a4f4-aef00eab141c) } result = Ok(())
34552024-09-05T00:48:35.040ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34562024-09-05T00:48:35.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34572024-09-05T00:48:35.043ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 87.520598ms iteration = 13 status = 0
34582024-09-05T00:48:35.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34592024-09-05T00:48:35.045ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
34602024-09-05T00:48:35.045ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 59a6be26-b8fa-4e7a-8244-7a4e92426c26 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
34612024-09-05T00:48:35.045ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
34622024-09-05T00:48:35.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34632024-09-05T00:48:35.045ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
34642024-09-05T00:48:35.045ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 90.080993ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
34652024-09-05T00:48:35.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34662024-09-05T00:48:35.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34672024-09-05T00:48:35.046ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34682024-09-05T00:48:35.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34692024-09-05T00:48:35.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34702024-09-05T00:48:35.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34712024-09-05T00:48:35.051ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34722024-09-05T00:48:35.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34732024-09-05T00:48:35.054ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 59a6be26-b8fa-4e7a-8244-7a4e92426c26 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
34742024-09-05T00:48:35.054ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
34752024-09-05T00:48:35.054ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-05 00:42:43.011780 UTC dns_group = internal generation = 1
34762024-09-05T00:48:35.054ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 100.994558ms iteration = 8 status = {"generation":1}
34772024-09-05T00:48:35.056ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 100.56324ms iteration = 13 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
34782024-09-05T00:48:35.058ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 102.886111ms iteration = 16 status = {"physical_disks_added":0}
34792024-09-05T00:48:35.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34802024-09-05T00:48:35.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34812024-09-05T00:48:35.060ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34822024-09-05T00:48:35.062ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
34832024-09-05T00:48:35.062ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 32541e10-8a85-4410-9858-67a9ab52251d dns_zone_name = oxide.test found_so_far = 0 version = 2
34842024-09-05T00:48:35.062ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34852024-09-05T00:48:35.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34862024-09-05T00:48:35.062ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34872024-09-05T00:48:35.062ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34882024-09-05T00:48:35.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34892024-09-05T00:48:35.063ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
34902024-09-05T00:48:35.063ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 103.262248ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
34912024-09-05T00:48:35.063ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34922024-09-05T00:48:35.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34932024-09-05T00:48:35.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34942024-09-05T00:48:35.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34952024-09-05T00:48:35.068ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 32541e10-8a85-4410-9858-67a9ab52251d dns_zone_name = oxide.test found_so_far = 1 version = 2
34962024-09-05T00:48:35.068ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
34972024-09-05T00:48:35.068ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-05 00:42:43.837540 UTC dns_group = external generation = 2
34982024-09-05T00:48:35.068ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 114.533549ms iteration = 8 status = {"generation":2}
34992024-09-05T00:48:35.083ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-05T00:42:33.143008Z, time_modified: 2024-09-05T00:42:33.143008Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2d4fccaa-0031-45b8-a053-9531608bab06, db_silo: Silo { identity: SiloIdentity { id: 2d4fccaa-0031-45b8-a053-9531608bab06, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-05T00:42:43.791199Z, time_modified: 2024-09-05T00:42:43.791199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2d4fccaa-0031-45b8-a053-9531608bab06, db_silo: Silo { identity: SiloIdentity { id: 2d4fccaa-0031-45b8-a053-9531608bab06, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-05T00:42:43.791199Z, time_modified: 2024-09-05T00:42:43.791199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017" }] }) }
35002024-09-05T00:48:35.083ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 129.857312ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2d4fccaa-0031-45b8-a053-9531608bab06","tls_certs":["a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017"]}},"default_endpoint":{"silo_id":"2d4fccaa-0031-45b8-a053-9531608bab06","tls_certs":["a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
35012024-09-05T00:48:35.092ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35022024-09-05T00:48:35.094ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35032024-09-05T00:48:35.094ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35042024-09-05T00:48:35.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35052024-09-05T00:48:35.114ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
35062024-09-05T00:48:35.114ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35072024-09-05T00:48:35.115ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f872b5c2-26f4-47c2-bab6-0661cee15511", "content-length": "26", "date": "Thu, 05 Sep 2024 00:48:34 GMT"} })
35082024-09-05T00:48:35.115ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35092024-09-05T00:48:35.117ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35102024-09-05T00:48:35.122ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
35112024-09-05T00:48:35.122ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35122024-09-05T00:48:35.122ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5c532cf2-c211-4913-aa43-ef3c869261b9", "content-length": "26", "date": "Thu, 05 Sep 2024 00:48:34 GMT"} })
35132024-09-05T00:48:35.122ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35142024-09-05T00:48:35.124ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35152024-09-05T00:48:35.168ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1282 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = b0db8b90-b8b9-43c5-8371-c0bd656f2a0b response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
35162024-09-05T00:48:35.182ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b zone_address = fd00:1122:3344:101::2
35172024-09-05T00:48:35.182ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35182024-09-05T00:48:35.182ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "66fb5f40-c57e-44a3-a7b2-31f066e47426", "content-length": "26", "date": "Thu, 05 Sep 2024 00:48:34 GMT"} })
35192024-09-05T00:48:35.182ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35202024-09-05T00:48:35.183ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
35212024-09-05T00:48:35.244ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
35222024-09-05T00:48:35.274ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35232024-09-05T00:48:35.285ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
35242024-09-05T00:48:35.315ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
35252024-09-05T00:48:35.315ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6ee98dbb-c104-4a55-8a11-e7083f58457e", "content-length": "1", "date": "Thu, 05 Sep 2024 00:48:34 GMT"} })
35262024-09-05T00:48:35.317ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35272024-09-05T00:48:35.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35282024-09-05T00:48:35.319ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35292024-09-05T00:48:35.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = d7fa5adb-935b-4383-97c2-6e07440c86ab roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
35302024-09-05T00:48:35.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = d7fa5adb-935b-4383-97c2-6e07440c86ab resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
35312024-09-05T00:48:35.323ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 369.270125ms iteration = 13 status = null
35322024-09-05T00:48:35.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = d7fa5adb-935b-4383-97c2-6e07440c86ab response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
35332024-09-05T00:48:35.329ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 376.305869ms iteration = 13 status = {}
35342024-09-05T00:48:35.350ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "69da40c2-59fd-4ab2-8155-fa05c55cb96b", "content-length": "691", "date": "Thu, 05 Sep 2024 00:48:35 GMT"} })
35352024-09-05T00:48:35.350ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
35362024-09-05T00:48:35.350ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
35372024-09-05T00:48:35.350ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
35382024-09-05T00:48:35.351ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0d04d7b3-8810-4db5-93cc-690be044c84b", "content-length": "372", "date": "Thu, 05 Sep 2024 00:48:34 GMT"} })
35392024-09-05T00:48:35.351ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35402024-09-05T00:48:35.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35412024-09-05T00:48:35.352ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 397.287453ms iteration = 13 status = {}
35422024-09-05T00:48:35.354ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35432024-09-05T00:48:35.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35442024-09-05T00:48:35.357ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35452024-09-05T00:48:35.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35462024-09-05T00:48:35.360ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35472024-09-05T00:48:35.360ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "feed9a17-f9d2-4187-846f-1c19e16cb061", "date": "Thu, 05 Sep 2024 00:48:35 GMT"} })
35482024-09-05T00:48:35.362ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 406.467857ms iteration = 14 status = {}
35492024-09-05T00:48:35.461ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
35502024-09-05T00:48:35.514ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
35512024-09-05T00:48:35.514ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "eb6efdd6-a3de-4908-a689-a94b14b9a984", "date": "Thu, 05 Sep 2024 00:48:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35522024-09-05T00:48:35.514ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35532024-09-05T00:48:35.516ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c6d25b7b-e287-42c1-aa91-a5706ace3b68", "date": "Thu, 05 Sep 2024 00:48:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35542024-09-05T00:48:35.516ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35552024-09-05T00:48:35.518ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35562024-09-05T00:48:35.518ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 564.50296ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
35572024-09-05T00:48:35.519ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35582024-09-05T00:48:35.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35592024-09-05T00:48:35.521ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 3013d0b1-47fb-4df1-97e5-7049d1043033, rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c4762fe-488f-4054-979a-f54d371ea654) } rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
35602024-09-05T00:48:35.521ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35612024-09-05T00:48:35.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35622024-09-05T00:48:35.531ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35632024-09-05T00:48:35.531ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1156d1e6-1a3d-4949-967a-383c83026d9f", "content-length": "121", "date": "Thu, 05 Sep 2024 00:48:34 GMT"} })
35642024-09-05T00:48:35.531ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
35652024-09-05T00:48:35.531ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c4762fe-488f-4054-979a-f54d371ea654
35662024-09-05T00:48:35.531ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35672024-09-05T00:48:35.532ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35682024-09-05T00:48:35.532ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
35692024-09-05T00:48:35.532ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
35702024-09-05T00:48:35.532ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
35712024-09-05T00:48:35.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35722024-09-05T00:48:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35732024-09-05T00:48:35.533ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35742024-09-05T00:48:35.533ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "17ed0678-5e43-4618-b26a-a0601702c7b3", "content-length": "2", "date": "Thu, 05 Sep 2024 00:48:34 GMT"} })
35752024-09-05T00:48:35.533ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35762024-09-05T00:48:35.533ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0ae92594-97d6-4372-82af-e10da432ee88", "content-length": "51", "date": "Thu, 05 Sep 2024 00:48:34 GMT"} })
35772024-09-05T00:48:35.533ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
35782024-09-05T00:48:35.533ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35792024-09-05T00:48:35.537ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
35802024-09-05T00:48:35.538ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "56f3c0d8-42da-40f5-9d8f-e0a7b0f20c5d", "date": "Thu, 05 Sep 2024 00:48:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35812024-09-05T00:48:35.538ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35822024-09-05T00:48:35.540ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "14d19dd9-ffe2-4758-bd31-bc37da47bb57", "date": "Thu, 05 Sep 2024 00:48:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35832024-09-05T00:48:35.540ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35842024-09-05T00:48:35.541ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "52de81c8-9bbd-416d-afd0-f254cf8f169e", "date": "Thu, 05 Sep 2024 00:48:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35852024-09-05T00:48:35.541ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35862024-09-05T00:48:35.542ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
35872024-09-05T00:48:35.542ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 588.918145ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
35882024-09-05T00:48:35.627ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d7a7cdd2-7621-4136-8e84-32c731f428fc", "date": "Thu, 05 Sep 2024 00:48:35 GMT"} })
35892024-09-05T00:48:35.627ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch = Switch0
35902024-09-05T00:48:35.627ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35912024-09-05T00:48:35.627ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d2d2a008-f65a-4663-a032-3f897db245ce", "content-length": "667", "date": "Thu, 05 Sep 2024 00:48:35 GMT"} })
35922024-09-05T00:48:35.627ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35932024-09-05T00:48:35.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35942024-09-05T00:48:35.631ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35952024-09-05T00:48:35.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35962024-09-05T00:48:35.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35972024-09-05T00:48:35.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2b6d2dea-891f-4e15-a5b6-7b7ccc13ea62 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
35982024-09-05T00:48:35.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35992024-09-05T00:48:35.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2b6d2dea-891f-4e15-a5b6-7b7ccc13ea62 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36002024-09-05T00:48:35.637ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36012024-09-05T00:48:35.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36022024-09-05T00:48:35.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2b6d2dea-891f-4e15-a5b6-7b7ccc13ea62 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36032024-09-05T00:48:35.643ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 688.111631ms iteration = 13 status = {}
36042024-09-05T00:48:36.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = dec2d0a8-d44a-46fa-a538-bffe73d50083 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36052024-09-05T00:48:36.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = dec2d0a8-d44a-46fa-a538-bffe73d50083 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36062024-09-05T00:48:36.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2765 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = dec2d0a8-d44a-46fa-a538-bffe73d50083 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36072024-09-05T00:48:37.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 775a556d-e980-468d-8f91-45032ed4ef29 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36082024-09-05T00:48:37.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 775a556d-e980-468d-8f91-45032ed4ef29 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36092024-09-05T00:48:37.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 775a556d-e980-468d-8f91-45032ed4ef29 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36102024-09-05T00:48:38.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7c40bc31-d479-468a-924d-bf6dc703181a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36112024-09-05T00:48:38.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7c40bc31-d479-468a-924d-bf6dc703181a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36122024-09-05T00:48:38.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7c40bc31-d479-468a-924d-bf6dc703181a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36132024-09-05T00:48:39.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8a856f84-9c31-44eb-a33e-b7b91c8bdf4b roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36142024-09-05T00:48:39.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8a856f84-9c31-44eb-a33e-b7b91c8bdf4b resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36152024-09-05T00:48:39.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8a856f84-9c31-44eb-a33e-b7b91c8bdf4b response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36162024-09-05T00:48:40.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2f072a83-66fc-4944-b1bf-77fd4ac7fa49 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36172024-09-05T00:48:40.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2f072a83-66fc-4944-b1bf-77fd4ac7fa49 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36182024-09-05T00:48:40.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2f072a83-66fc-4944-b1bf-77fd4ac7fa49 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36192024-09-05T00:48:41.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1fca22a5-2105-480b-a3c4-58b6dc661b28 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36202024-09-05T00:48:41.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1fca22a5-2105-480b-a3c4-58b6dc661b28 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36212024-09-05T00:48:41.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1fca22a5-2105-480b-a3c4-58b6dc661b28 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36222024-09-05T00:48:42.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 707dc915-28da-4a4c-bf9b-5a83c5d7ab4b roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36232024-09-05T00:48:42.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 707dc915-28da-4a4c-bf9b-5a83c5d7ab4b resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36242024-09-05T00:48:42.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 707dc915-28da-4a4c-bf9b-5a83c5d7ab4b response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36252024-09-05T00:48:43.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6e69869c-3b3f-4f15-8a96-81ba3f988aac roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36262024-09-05T00:48:43.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6e69869c-3b3f-4f15-8a96-81ba3f988aac resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36272024-09-05T00:48:43.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2471 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6e69869c-3b3f-4f15-8a96-81ba3f988aac response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36282024-09-05T00:48:44.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 79cdccb1-6879-4706-b94d-9824aae5f86a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36292024-09-05T00:48:44.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 79cdccb1-6879-4706-b94d-9824aae5f86a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36302024-09-05T00:48:44.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 79cdccb1-6879-4706-b94d-9824aae5f86a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36312024-09-05T00:48:44.956ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
36322024-09-05T00:48:44.956ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
36332024-09-05T00:48:44.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36342024-09-05T00:48:44.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36352024-09-05T00:48:44.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36362024-09-05T00:48:44.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36372024-09-05T00:48:44.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36382024-09-05T00:48:44.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36392024-09-05T00:48:44.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36402024-09-05T00:48:44.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.556314ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36412024-09-05T00:48:44.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36422024-09-05T00:48:44.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36432024-09-05T00:48:44.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36442024-09-05T00:48:44.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36452024-09-05T00:48:44.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36462024-09-05T00:48:44.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36472024-09-05T00:48:44.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
36482024-09-05T00:48:44.990ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36492024-09-05T00:48:44.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36502024-09-05T00:48:44.996ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
36512024-09-05T00:48:44.996ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.745066ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
36522024-09-05T00:48:45.168ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1227 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 3d51035a-42de-47ca-a1ab-8bf57768f138 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
36532024-09-05T00:48:45.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b4947088-de3c-4faf-bcfb-23cd1be8c3ef roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36542024-09-05T00:48:45.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b4947088-de3c-4faf-bcfb-23cd1be8c3ef resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36552024-09-05T00:48:45.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1891 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b4947088-de3c-4faf-bcfb-23cd1be8c3ef response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36562024-09-05T00:48:46.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e1c144a6-1978-4dda-a30a-36d4ef9ded98 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36572024-09-05T00:48:46.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e1c144a6-1978-4dda-a30a-36d4ef9ded98 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36582024-09-05T00:48:46.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e1c144a6-1978-4dda-a30a-36d4ef9ded98 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36592024-09-05T00:48:47.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d897f080-d609-46d4-b376-9f5ad8d22ab5 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36602024-09-05T00:48:47.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d897f080-d609-46d4-b376-9f5ad8d22ab5 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36612024-09-05T00:48:47.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1682 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d897f080-d609-46d4-b376-9f5ad8d22ab5 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36622024-09-05T00:48:48.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fdc51c8b-29bd-45d5-9ba2-291b707832a2 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36632024-09-05T00:48:48.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fdc51c8b-29bd-45d5-9ba2-291b707832a2 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36642024-09-05T00:48:48.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fdc51c8b-29bd-45d5-9ba2-291b707832a2 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36652024-09-05T00:48:49.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 68fbef26-6777-44d9-a5d7-bda5c5a51a52 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36662024-09-05T00:48:49.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 68fbef26-6777-44d9-a5d7-bda5c5a51a52 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36672024-09-05T00:48:49.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 68fbef26-6777-44d9-a5d7-bda5c5a51a52 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36682024-09-05T00:48:50.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 53c2e317-e9c7-4d44-9bb5-daf3c6c78735 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36692024-09-05T00:48:50.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 53c2e317-e9c7-4d44-9bb5-daf3c6c78735 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36702024-09-05T00:48:50.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 53c2e317-e9c7-4d44-9bb5-daf3c6c78735 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36712024-09-05T00:48:51.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b6cda487-a6f1-4115-8d79-e1a948028200 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36722024-09-05T00:48:51.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b6cda487-a6f1-4115-8d79-e1a948028200 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36732024-09-05T00:48:51.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b6cda487-a6f1-4115-8d79-e1a948028200 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36742024-09-05T00:48:53.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0135ce2a-9b62-4724-bf35-a32c12a10c33 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36752024-09-05T00:48:53.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0135ce2a-9b62-4724-bf35-a32c12a10c33 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36762024-09-05T00:48:53.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0135ce2a-9b62-4724-bf35-a32c12a10c33 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36772024-09-05T00:48:54.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b439d060-b648-4b29-9f09-b0348b14c580 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36782024-09-05T00:48:54.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b439d060-b648-4b29-9f09-b0348b14c580 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36792024-09-05T00:48:54.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b439d060-b648-4b29-9f09-b0348b14c580 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
36802024-09-05T00:48:54.956ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
36812024-09-05T00:48:54.956ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
36822024-09-05T00:48:54.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36832024-09-05T00:48:54.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36842024-09-05T00:48:54.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36852024-09-05T00:48:54.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36862024-09-05T00:48:54.963ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36872024-09-05T00:48:54.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36882024-09-05T00:48:54.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36892024-09-05T00:48:54.965ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 9.112882ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36902024-09-05T00:48:54.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36912024-09-05T00:48:54.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36922024-09-05T00:48:54.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36932024-09-05T00:48:54.967ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36942024-09-05T00:48:54.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36952024-09-05T00:48:54.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36962024-09-05T00:48:54.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
36972024-09-05T00:48:54.971ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36982024-09-05T00:48:54.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36992024-09-05T00:48:54.977ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
37002024-09-05T00:48:54.978ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.811798ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
37012024-09-05T00:48:55.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0fada923-c161-41b8-a86b-9f7b06273b4e roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37022024-09-05T00:48:55.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0fada923-c161-41b8-a86b-9f7b06273b4e resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37032024-09-05T00:48:55.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0fada923-c161-41b8-a86b-9f7b06273b4e response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37042024-09-05T00:48:55.169ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = d2591a0a-6f00-43a0-84f6-27b23656cf29 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
37052024-09-05T00:48:56.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 410f4112-5699-44b4-b5f3-3f047d7d39b2 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37062024-09-05T00:48:56.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 410f4112-5699-44b4-b5f3-3f047d7d39b2 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37072024-09-05T00:48:56.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 410f4112-5699-44b4-b5f3-3f047d7d39b2 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37082024-09-05T00:48:57.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7503ae14-b5e4-436f-ac0f-16745e335c95 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37092024-09-05T00:48:57.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7503ae14-b5e4-436f-ac0f-16745e335c95 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37102024-09-05T00:48:57.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7503ae14-b5e4-436f-ac0f-16745e335c95 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37112024-09-05T00:48:58.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 965b51a0-40a6-489e-9098-31ac7e42ecf6 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37122024-09-05T00:48:58.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 965b51a0-40a6-489e-9098-31ac7e42ecf6 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37132024-09-05T00:48:58.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 965b51a0-40a6-489e-9098-31ac7e42ecf6 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37142024-09-05T00:48:59.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 32b4453b-28f7-4ec9-89da-a42b7e7fff7a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37152024-09-05T00:48:59.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 32b4453b-28f7-4ec9-89da-a42b7e7fff7a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37162024-09-05T00:48:59.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1703 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 32b4453b-28f7-4ec9-89da-a42b7e7fff7a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37172024-09-05T00:49:00.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba0ae89e-d8c5-4976-8f2e-6ca0556b32f5 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37182024-09-05T00:49:00.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba0ae89e-d8c5-4976-8f2e-6ca0556b32f5 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37192024-09-05T00:49:00.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba0ae89e-d8c5-4976-8f2e-6ca0556b32f5 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37202024-09-05T00:49:01.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1308c5f2-2c56-49b9-858f-079022d33549 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37212024-09-05T00:49:01.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1308c5f2-2c56-49b9-858f-079022d33549 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37222024-09-05T00:49:01.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1308c5f2-2c56-49b9-858f-079022d33549 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37232024-09-05T00:49:01.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = a74ae0b8-0905-4cc1-b3ce-b4dcd5ab4814 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
37242024-09-05T00:49:01.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = a74ae0b8-0905-4cc1-b3ce-b4dcd5ab4814 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
37252024-09-05T00:49:01.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6498 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = a74ae0b8-0905-4cc1-b3ce-b4dcd5ab4814 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
37262024-09-05T00:49:01.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 390b69eb-c93f-4ebc-87a5-53597646751f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
37272024-09-05T00:49:01.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 390b69eb-c93f-4ebc-87a5-53597646751f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
37282024-09-05T00:49:01.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 13630 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 390b69eb-c93f-4ebc-87a5-53597646751f response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
37292024-09-05T00:49:02.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bc81ab4e-ea54-4c9c-af30-6d9af27effd8 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37302024-09-05T00:49:02.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bc81ab4e-ea54-4c9c-af30-6d9af27effd8 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37312024-09-05T00:49:02.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2892 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bc81ab4e-ea54-4c9c-af30-6d9af27effd8 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37322024-09-05T00:49:03.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c48e1cfb-99ab-42c4-bb19-937f4db5fdec roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37332024-09-05T00:49:03.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c48e1cfb-99ab-42c4-bb19-937f4db5fdec resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37342024-09-05T00:49:03.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c48e1cfb-99ab-42c4-bb19-937f4db5fdec response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37352024-09-05T00:49:04.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b3fe75e8-8cbc-40c1-a51c-7a70118e3857 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37362024-09-05T00:49:04.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b3fe75e8-8cbc-40c1-a51c-7a70118e3857 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37372024-09-05T00:49:04.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b3fe75e8-8cbc-40c1-a51c-7a70118e3857 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
37382024-09-05T00:49:04.953ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
37392024-09-05T00:49:04.953ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37402024-09-05T00:49:04.953ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
37412024-09-05T00:49:04.953ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
37422024-09-05T00:49:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37432024-09-05T00:49:04.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
37442024-09-05T00:49:04.954ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
37452024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
37462024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
37472024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
37482024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37492024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37502024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37512024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37522024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
37532024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37542024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
37552024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
37562024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37572024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37582024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
37592024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37602024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
37612024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
37622024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37632024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
37642024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37652024-09-05T00:49:04.955ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37662024-09-05T00:49:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37672024-09-05T00:49:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37682024-09-05T00:49:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37692024-09-05T00:49:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37702024-09-05T00:49:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37712024-09-05T00:49:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37722024-09-05T00:49:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37732024-09-05T00:49:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37742024-09-05T00:49:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37752024-09-05T00:49:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37762024-09-05T00:49:04.956ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3807, tv_nsec: 22073005 } })
37772024-09-05T00:49:04.957ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3807, tv_nsec: 22832799 } })
37782024-09-05T00:49:04.957ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
37792024-09-05T00:49:04.957ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37802024-09-05T00:49:04.958ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
37812024-09-05T00:49:04.959ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.48704ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
37822024-09-05T00:49:04.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37832024-09-05T00:49:04.959ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37842024-09-05T00:49:04.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37852024-09-05T00:49:04.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37862024-09-05T00:49:04.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37872024-09-05T00:49:04.960ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
37882024-09-05T00:49:04.960ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
37892024-09-05T00:49:04.960ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37902024-09-05T00:49:04.960ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
37912024-09-05T00:49:04.960ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37922024-09-05T00:49:04.960ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
37932024-09-05T00:49:04.960ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
37942024-09-05T00:49:04.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37952024-09-05T00:49:04.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37962024-09-05T00:49:04.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
37972024-09-05T00:49:04.961ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37982024-09-05T00:49:04.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37992024-09-05T00:49:04.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38002024-09-05T00:49:04.962ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38012024-09-05T00:49:04.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
38022024-09-05T00:49:04.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38032024-09-05T00:49:04.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38042024-09-05T00:49:04.963ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38052024-09-05T00:49:04.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38062024-09-05T00:49:04.964ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38072024-09-05T00:49:04.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38082024-09-05T00:49:04.964ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38092024-09-05T00:49:04.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38102024-09-05T00:49:04.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
38112024-09-05T00:49:04.965ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38122024-09-05T00:49:04.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38132024-09-05T00:49:04.967ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3807, tv_nsec: 32871847 } })
38142024-09-05T00:49:04.967ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
38152024-09-05T00:49:04.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38162024-09-05T00:49:04.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38172024-09-05T00:49:04.969ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.390488ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38182024-09-05T00:49:04.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38192024-09-05T00:49:04.969ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38202024-09-05T00:49:04.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38212024-09-05T00:49:04.970ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38222024-09-05T00:49:04.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38232024-09-05T00:49:04.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38242024-09-05T00:49:04.989ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38252024-09-05T00:49:04.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38262024-09-05T00:49:04.992ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38272024-09-05T00:49:04.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38282024-09-05T00:49:04.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38292024-09-05T00:49:04.994ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38302024-09-05T00:49:04.995ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 35.541882ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
38312024-09-05T00:49:04.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38322024-09-05T00:49:04.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38332024-09-05T00:49:04.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38342024-09-05T00:49:04.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a014d257-275c-449e-a4f4-aef00eab141c, lookup_type: ById(a014d257-275c-449e-a4f4-aef00eab141c) } result = Ok(())
38352024-09-05T00:49:04.997ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38362024-09-05T00:49:04.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38372024-09-05T00:49:04.999ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38382024-09-05T00:49:04.999ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
38392024-09-05T00:49:04.999ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
38402024-09-05T00:49:04.999ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38412024-09-05T00:49:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38422024-09-05T00:49:05.000ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 44.253007ms iteration = 14 status = 0
38432024-09-05T00:49:05.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38442024-09-05T00:49:05.001ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38452024-09-05T00:49:05.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38462024-09-05T00:49:05.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38472024-09-05T00:49:05.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38482024-09-05T00:49:05.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38492024-09-05T00:49:05.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38502024-09-05T00:49:05.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38512024-09-05T00:49:05.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38522024-09-05T00:49:05.007ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38532024-09-05T00:49:05.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38542024-09-05T00:49:05.008ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38552024-09-05T00:49:05.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38562024-09-05T00:49:05.009ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 49.055403ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
38572024-09-05T00:49:05.009ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38582024-09-05T00:49:05.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38592024-09-05T00:49:05.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.663909ms iteration = 14 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
38602024-09-05T00:49:05.035ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
38612024-09-05T00:49:05.035ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38622024-09-05T00:49:05.036ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "647ea6ed-7b9c-4346-81a7-a92ce028ce2a", "content-length": "26", "date": "Thu, 05 Sep 2024 00:49:04 GMT"} })
38632024-09-05T00:49:05.036ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38642024-09-05T00:49:05.036ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 81.040743ms iteration = 17 status = {"physical_disks_added":0}
38652024-09-05T00:49:05.038ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38662024-09-05T00:49:05.039ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
38672024-09-05T00:49:05.039ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38682024-09-05T00:49:05.039ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 84.120327ms iteration = 14 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
38692024-09-05T00:49:05.043ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
38702024-09-05T00:49:05.043ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 83.517237ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
38712024-09-05T00:49:05.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38722024-09-05T00:49:05.051ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b zone_address = fd00:1122:3344:101::2
38732024-09-05T00:49:05.051ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38742024-09-05T00:49:05.051ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d635f3d7-754e-41a6-a993-0d00d377a2b7", "content-length": "26", "date": "Thu, 05 Sep 2024 00:49:04 GMT"} })
38752024-09-05T00:49:05.051ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38762024-09-05T00:49:05.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
38772024-09-05T00:49:05.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38782024-09-05T00:49:05.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38792024-09-05T00:49:05.054ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
38802024-09-05T00:49:05.060ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
38812024-09-05T00:49:05.060ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38822024-09-05T00:49:05.061ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dd87568d-94db-4769-a51f-7a051293585b", "content-length": "26", "date": "Thu, 05 Sep 2024 00:49:04 GMT"} })
38832024-09-05T00:49:05.061ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38842024-09-05T00:49:05.062ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38852024-09-05T00:49:05.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38862024-09-05T00:49:05.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38872024-09-05T00:49:05.168ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1288 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = a94b0a0a-1706-49b6-baa0-2a82ebd826bb response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
38882024-09-05T00:49:05.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 03ffe731-d4f2-4da5-81f4-3aff193bcde9 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
38892024-09-05T00:49:05.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 03ffe731-d4f2-4da5-81f4-3aff193bcde9 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
38902024-09-05T00:49:05.318ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 365.14738ms iteration = 14 status = {}
38912024-09-05T00:49:05.320ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38922024-09-05T00:49:05.320ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5a08917b-8f5b-49d8-8b1f-a6f4df283555", "content-length": "585", "date": "Thu, 05 Sep 2024 00:49:04 GMT"} })
38932024-09-05T00:49:05.320ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38942024-09-05T00:49:05.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38952024-09-05T00:49:05.322ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38962024-09-05T00:49:05.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 56923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 03ffe731-d4f2-4da5-81f4-3aff193bcde9 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
38972024-09-05T00:49:05.324ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38982024-09-05T00:49:05.324ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38992024-09-05T00:49:05.324ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39002024-09-05T00:49:05.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39012024-09-05T00:49:05.325ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c26f7cb4-df7e-4e93-8ba0-aa0a0137c092", "content-length": "1", "date": "Thu, 05 Sep 2024 00:49:05 GMT"} })
39022024-09-05T00:49:05.326ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39032024-09-05T00:49:05.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39042024-09-05T00:49:05.327ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63/state
39052024-09-05T00:49:05.329ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39062024-09-05T00:49:05.329ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
39072024-09-05T00:49:05.329ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39082024-09-05T00:49:05.329ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 375.601706ms iteration = 14 status = null
39092024-09-05T00:49:05.329ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 373.5476ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
39102024-09-05T00:49:05.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39112024-09-05T00:49:05.330ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39122024-09-05T00:49:05.330ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39132024-09-05T00:49:05.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39142024-09-05T00:49:05.331ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39152024-09-05T00:49:05.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39162024-09-05T00:49:05.334ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39172024-09-05T00:49:05.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39182024-09-05T00:49:05.336ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39192024-09-05T00:49:05.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39202024-09-05T00:49:05.338ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39212024-09-05T00:49:05.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39222024-09-05T00:49:05.341ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39232024-09-05T00:49:05.341ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "14ec121e-fd57-4536-9174-c8939912558d", "date": "Thu, 05 Sep 2024 00:49:04 GMT"} })
39242024-09-05T00:49:05.343ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 387.371876ms iteration = 15 status = {}
39252024-09-05T00:49:05.357ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39262024-09-05T00:49:05.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39272024-09-05T00:49:05.359ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 3013d0b1-47fb-4df1-97e5-7049d1043033, rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c4762fe-488f-4054-979a-f54d371ea654) } rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
39282024-09-05T00:49:05.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39292024-09-05T00:49:05.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39302024-09-05T00:49:05.367ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
39312024-09-05T00:49:05.368ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6714b919-590a-4284-a4b6-488ba009d4d9", "content-length": "121", "date": "Thu, 05 Sep 2024 00:49:05 GMT"} })
39322024-09-05T00:49:05.368ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
39332024-09-05T00:49:05.368ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c4762fe-488f-4054-979a-f54d371ea654
39342024-09-05T00:49:05.368ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39352024-09-05T00:49:05.368ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39362024-09-05T00:49:05.368ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
39372024-09-05T00:49:05.368ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
39382024-09-05T00:49:05.368ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
39392024-09-05T00:49:05.368ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39402024-09-05T00:49:05.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39412024-09-05T00:49:05.370ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
39422024-09-05T00:49:05.370ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5059e839-0bed-4e24-a720-7930400b9e7e", "content-length": "2", "date": "Thu, 05 Sep 2024 00:49:05 GMT"} })
39432024-09-05T00:49:05.370ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
39442024-09-05T00:49:05.371ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "17d718aa-3732-4b93-9745-1a1ff3582565", "content-length": "51", "date": "Thu, 05 Sep 2024 00:49:05 GMT"} })
39452024-09-05T00:49:05.371ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
39462024-09-05T00:49:05.371ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
39472024-09-05T00:49:05.415ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
39482024-09-05T00:49:05.465ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4cffa400-07f3-4c95-b8a8-a5cce24c40f6", "date": "Thu, 05 Sep 2024 00:49:04 GMT"} })
39492024-09-05T00:49:05.465ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch = Switch0
39502024-09-05T00:49:05.465ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
39512024-09-05T00:49:05.465ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "caca59b4-6b8c-41db-a6cc-2d76b64ad853", "content-length": "811", "date": "Thu, 05 Sep 2024 00:49:04 GMT"} })
39522024-09-05T00:49:05.465ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 241, 117, 70])), vni: Vni(15632793) }} sled = buskin
39532024-09-05T00:49:05.465ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
39542024-09-05T00:49:05.465ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
39552024-09-05T00:49:05.465ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ab172e82-7220-436b-8b5a-5472cb6d9aa6", "content-length": "667", "date": "Thu, 05 Sep 2024 00:49:04 GMT"} })
39562024-09-05T00:49:05.466ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39572024-09-05T00:49:05.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39582024-09-05T00:49:05.466ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 511.16582ms iteration = 14 status = {}
39592024-09-05T00:49:05.469ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39602024-09-05T00:49:05.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39612024-09-05T00:49:05.473ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39622024-09-05T00:49:05.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39632024-09-05T00:49:05.475ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39642024-09-05T00:49:05.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39652024-09-05T00:49:05.481ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 526.017655ms iteration = 14 status = {}
39662024-09-05T00:49:06.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f1d5f361-533d-4a51-8757-fa965d7f99bb roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
39672024-09-05T00:49:06.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f1d5f361-533d-4a51-8757-fa965d7f99bb resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
39682024-09-05T00:49:06.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f1d5f361-533d-4a51-8757-fa965d7f99bb response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
39692024-09-05T00:49:07.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b3cb7678-7ee5-468b-9274-90cff616afb7 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
39702024-09-05T00:49:07.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b3cb7678-7ee5-468b-9274-90cff616afb7 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
39712024-09-05T00:49:07.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b3cb7678-7ee5-468b-9274-90cff616afb7 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
39722024-09-05T00:49:08.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = be337edc-44ba-41bc-a651-1439101e3edf roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
39732024-09-05T00:49:08.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = be337edc-44ba-41bc-a651-1439101e3edf resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
39742024-09-05T00:49:08.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2638 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = be337edc-44ba-41bc-a651-1439101e3edf response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
39752024-09-05T00:49:09.036ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = instance_watcher result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63/state", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6194cbef-a56c-4743-85a3-3bd8570758bd", "content-length": "128", "date": "Thu, 05 Sep 2024 00:49:09 GMT"} })
39762024-09-05T00:49:09.039ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 state = Starting
39772024-09-05T00:49:09.042ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:1853 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-09-05T00:49:00.635406Z }
39782024-09-05T00:49:09.042ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b08b733e-d8cb-47a7-b36a-175ac23cf013 uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-09-05T00:49:09.037122719Z }
39792024-09-05T00:49:09.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 roles = RoleSet { roles: {} }
39802024-09-05T00:49:09.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b08b733e-d8cb-47a7-b36a-175ac23cf013 roles = RoleSet { roles: {} } uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
39812024-09-05T00:49:09.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b08b733e-d8cb-47a7-b36a-175ac23cf013 resource = Database result = Ok(()) uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
39822024-09-05T00:49:09.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 resource = Database result = Ok(())
39832024-09-05T00:49:09.053ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
39842024-09-05T00:49:09.053ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 4.09755128s iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
39852024-09-05T00:49:09.074ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:60266
39862024-09-05T00:49:09.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:60266 req_id = 2d38521a-afa6-47fd-a7ec-d6ee0bedf862 roles = RoleSet { roles: {} } uri = /metrics/producers
39872024-09-05T00:49:09.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:60266 req_id = 2d38521a-afa6-47fd-a7ec-d6ee0bedf862 resource = Database result = Ok(()) uri = /metrics/producers
39882024-09-05T00:49:09.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 57738 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b08b733e-d8cb-47a7-b36a-175ac23cf013 response_code = 204 uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
39892024-09-05T00:49:09.095ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d0ffda37-e0a0-43fa-8da1-2fee128f9741 uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63 vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-09-05T00:49:09.095382376Z }
39902024-09-05T00:49:09.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d0ffda37-e0a0-43fa-8da1-2fee128f9741 roles = RoleSet { roles: {} } uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
39912024-09-05T00:49:09.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d0ffda37-e0a0-43fa-8da1-2fee128f9741 resource = Database result = Ok(()) uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
39922024-09-05T00:49:09.108ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
39932024-09-05T00:49:09.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:60266 req_id = 2d38521a-afa6-47fd-a7ec-d6ee0bedf862 roles = RoleSet { roles: {} } uri = /metrics/producers
39942024-09-05T00:49:09.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:60266 req_id = 2d38521a-afa6-47fd-a7ec-d6ee0bedf862 resource = Database result = Ok(()) uri = /metrics/producers
39952024-09-05T00:49:09.117ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
39962024-09-05T00:49:09.117ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d01c57f8-ad7a-4327-8a00-071d9cacf671", "date": "Thu, 05 Sep 2024 00:49:09 GMT"} })
39972024-09-05T00:49:09.117ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815
39982024-09-05T00:49:09.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 45111 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:60266 req_id = 2d38521a-afa6-47fd-a7ec-d6ee0bedf862 response_code = 201 uri = /metrics/producers
39992024-09-05T00:49:09.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 34272 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d0ffda37-e0a0-43fa-8da1-2fee128f9741 response_code = 204 uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40002024-09-05T00:49:09.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7636ce08-d760-4a79-a486-0a2f29e1bfd8 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40012024-09-05T00:49:09.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7636ce08-d760-4a79-a486-0a2f29e1bfd8 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40022024-09-05T00:49:09.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7636ce08-d760-4a79-a486-0a2f29e1bfd8 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40032024-09-05T00:49:10.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 162372f9-e318-4bb2-9b6d-ce8160106f25 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40042024-09-05T00:49:10.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 162372f9-e318-4bb2-9b6d-ce8160106f25 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40052024-09-05T00:49:10.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 162372f9-e318-4bb2-9b6d-ce8160106f25 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40062024-09-05T00:49:11.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 512a12f7-bbb5-4963-9749-06f45280ee21 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40072024-09-05T00:49:11.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 512a12f7-bbb5-4963-9749-06f45280ee21 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40082024-09-05T00:49:11.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 512a12f7-bbb5-4963-9749-06f45280ee21 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40092024-09-05T00:49:12.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4f2bc2d7-efd9-457c-9be1-383d51601206 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40102024-09-05T00:49:12.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4f2bc2d7-efd9-457c-9be1-383d51601206 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40112024-09-05T00:49:12.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4f2bc2d7-efd9-457c-9be1-383d51601206 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40122024-09-05T00:49:13.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ff727161-cac6-443e-b67f-bb14d57792bd roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40132024-09-05T00:49:13.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ff727161-cac6-443e-b67f-bb14d57792bd resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40142024-09-05T00:49:13.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ff727161-cac6-443e-b67f-bb14d57792bd response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40152024-09-05T00:49:14.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = da2e1d6f-5fb1-4c6f-bdc7-a5c6c5bd4eec roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40162024-09-05T00:49:14.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = da2e1d6f-5fb1-4c6f-bdc7-a5c6c5bd4eec resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40172024-09-05T00:49:14.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = da2e1d6f-5fb1-4c6f-bdc7-a5c6c5bd4eec response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40182024-09-05T00:49:14.955ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
40192024-09-05T00:49:14.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40202024-09-05T00:49:14.956ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
40212024-09-05T00:49:14.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40222024-09-05T00:49:14.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40232024-09-05T00:49:14.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40242024-09-05T00:49:14.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40252024-09-05T00:49:14.958ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40262024-09-05T00:49:14.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40272024-09-05T00:49:14.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40282024-09-05T00:49:14.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40292024-09-05T00:49:14.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40302024-09-05T00:49:14.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40312024-09-05T00:49:14.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40322024-09-05T00:49:14.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40332024-09-05T00:49:14.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
40342024-09-05T00:49:14.967ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40352024-09-05T00:49:14.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40362024-09-05T00:49:14.974ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
40372024-09-05T00:49:14.974ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.424268ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
40382024-09-05T00:49:14.991ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.195256ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40392024-09-05T00:49:15.172ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4410 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 00b326f4-1a61-4491-96f8-e66698ac50be response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
40402024-09-05T00:49:15.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8ac0c508-3e78-49a9-af72-934cc9054c93 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40412024-09-05T00:49:15.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8ac0c508-3e78-49a9-af72-934cc9054c93 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40422024-09-05T00:49:15.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8ac0c508-3e78-49a9-af72-934cc9054c93 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40432024-09-05T00:49:16.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9f230ba0-cae4-4aaf-a66f-d83dd9175ce9 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40442024-09-05T00:49:16.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9f230ba0-cae4-4aaf-a66f-d83dd9175ce9 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40452024-09-05T00:49:16.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9f230ba0-cae4-4aaf-a66f-d83dd9175ce9 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40462024-09-05T00:49:17.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 483a8400-049a-4165-b736-b741a846a611 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40472024-09-05T00:49:17.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 483a8400-049a-4165-b736-b741a846a611 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40482024-09-05T00:49:17.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1782 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 483a8400-049a-4165-b736-b741a846a611 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40492024-09-05T00:49:18.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4c9bce0d-b32a-4fb8-823b-44f442f296c7 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40502024-09-05T00:49:18.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4c9bce0d-b32a-4fb8-823b-44f442f296c7 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40512024-09-05T00:49:18.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4c9bce0d-b32a-4fb8-823b-44f442f296c7 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40522024-09-05T00:49:18.911ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 15551be0-cd88-4a34-aaa0-d8e839fe1c23 uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-09-05T00:49:18.910818461Z }
40532024-09-05T00:49:18.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 15551be0-cd88-4a34-aaa0-d8e839fe1c23 roles = RoleSet { roles: {} } uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40542024-09-05T00:49:18.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 15551be0-cd88-4a34-aaa0-d8e839fe1c23 resource = Database result = Ok(()) uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40552024-09-05T00:49:18.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 25067 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 15551be0-cd88-4a34-aaa0-d8e839fe1c23 response_code = 204 uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40562024-09-05T00:49:19.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 9abb4a8a-ff38-4747-b201-2b5d88ca8072 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
40572024-09-05T00:49:19.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 9abb4a8a-ff38-4747-b201-2b5d88ca8072 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
40582024-09-05T00:49:19.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3847 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 9abb4a8a-ff38-4747-b201-2b5d88ca8072 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
40592024-09-05T00:49:19.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = c1ac1522-35b1-431f-b367-b5a2bac6ffba roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
40602024-09-05T00:49:19.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = c1ac1522-35b1-431f-b367-b5a2bac6ffba resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
40612024-09-05T00:49:19.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = c1ac1522-35b1-431f-b367-b5a2bac6ffba response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
40622024-09-05T00:49:19.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 16348b56-62a3-4a94-a2cd-e9e58df59966 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40632024-09-05T00:49:19.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 16348b56-62a3-4a94-a2cd-e9e58df59966 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40642024-09-05T00:49:19.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 16348b56-62a3-4a94-a2cd-e9e58df59966 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40652024-09-05T00:49:20.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 161b63a5-0a25-4e41-bfd4-5821b820f847 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40662024-09-05T00:49:20.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 161b63a5-0a25-4e41-bfd4-5821b820f847 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40672024-09-05T00:49:20.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 161b63a5-0a25-4e41-bfd4-5821b820f847 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
40682024-09-05T00:49:21.346ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-09-05T00:49:21.345972414Z }
40692024-09-05T00:49:21.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a roles = RoleSet { roles: {} } uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40702024-09-05T00:49:21.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a resource = Database result = Ok(()) uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40712024-09-05T00:49:21.363ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63 vmm_needs_update = true
40722024-09-05T00:49:21.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a roles = RoleSet { roles: {} } uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40732024-09-05T00:49:21.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a resource = Database result = Ok(()) uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40742024-09-05T00:49:21.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a roles = RoleSet { roles: {} } uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40752024-09-05T00:49:21.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a resource = Database result = Ok(()) uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40762024-09-05T00:49:21.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a roles = RoleSet { roles: {} } uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40772024-09-05T00:49:21.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a resource = Database result = Ok(()) uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40782024-09-05T00:49:21.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a roles = RoleSet { roles: {} } uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40792024-09-05T00:49:21.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a resource = Database result = Ok(()) uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40802024-09-05T00:49:21.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a roles = RoleSet { roles: {} } uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40812024-09-05T00:49:21.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a resource = Database result = Ok(()) uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40822024-09-05T00:49:21.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a roles = RoleSet { roles: {} } uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40832024-09-05T00:49:21.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a resource = Database result = Ok(()) uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40842024-09-05T00:49:21.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40852024-09-05T00:49:21.377ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2d4fccaa-0031-45b8-a053-9531608bab06, lookup_type: ById(2d4fccaa-0031-45b8-a053-9531608bab06) }, key: 43eeffc2-5843-4008-bed9-ec069e561096, lookup_type: ById(43eeffc2-5843-4008-bed9-ec069e561096) }, key: 4ff1e132-d479-46d8-a4e0-3ec93be9d815, lookup_type: ById(4ff1e132-d479-46d8-a4e0-3ec93be9d815) } result = Ok(()) uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40862024-09-05T00:49:21.380ZINFOnexus (dropshot_internal): starting update saga for 4ff1e132-d479-46d8-a4e0-3ec93be9d815 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1349 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-09-05T00:49:21.345972414Z }
40872024-09-05T00:49:21.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 34114 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ba83a3b9-824a-4e56-876b-9f7b15b89b5a response_code = 204 uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40882024-09-05T00:49:21.380ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1853 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a868ad05-412a-4919-8ff9-0fde3e0c073d uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-09-05T00:49:21.345972414Z }
40892024-09-05T00:49:21.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a868ad05-412a-4919-8ff9-0fde3e0c073d roles = RoleSet { roles: {} } uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40902024-09-05T00:49:21.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a868ad05-412a-4919-8ff9-0fde3e0c073d resource = Database result = Ok(()) uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40912024-09-05T00:49:21.383ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update
40922024-09-05T00:49:21.383ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"4ff1e132-d479-46d8-a4e0-3ec93be9d815","lookup_type":{"ById":"4ff1e132-d479-46d8-a4e0-3ec93be9d815"},"parent":{"key":"43eeffc2-5843-4008-bed9-ec069e561096","lookup_type":{"ById":"43eeffc2-5843-4008-bed9-ec069e561096"},"parent":{"key":"2d4fccaa-0031-45b8-a053-9531608bab06","lookup_type":{"ById":"2d4fccaa-0031-45b8-a053-9531608bab06"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
40932024-09-05T00:49:21.383ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update
40942024-09-05T00:49:21.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3405 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a868ad05-412a-4919-8ff9-0fde3e0c073d response_code = 204 uri = /vmms/74d206fd-7b85-46a8-90a5-4557f96d3a63
40952024-09-05T00:49:21.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 318967c8-fb11-4c7c-a70c-c229a15d2969 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
40962024-09-05T00:49:21.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 318967c8-fb11-4c7c-a70c-c229a15d2969 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
40972024-09-05T00:49:21.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 318967c8-fb11-4c7c-a70c-c229a15d2969 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
40982024-09-05T00:49:21.419ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update
40992024-09-05T00:49:21.419ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41002024-09-05T00:49:21.419ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41012024-09-05T00:49:21.419ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683
41022024-09-05T00:49:21.429ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41032024-09-05T00:49:21.429ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683
41042024-09-05T00:49:21.435ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41052024-09-05T00:49:21.435ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683
41062024-09-05T00:49:21.441ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41072024-09-05T00:49:21.441ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("967764e2-65c9-4144-9515-266bc4ffb610")) node_id = 0 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683
41082024-09-05T00:49:21.446ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41092024-09-05T00:49:21.446ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683
41102024-09-05T00:49:21.456ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update
41112024-09-05T00:49:21.456ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41122024-09-05T00:49:21.456ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41132024-09-05T00:49:21.458ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41142024-09-05T00:49:21.458ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41152024-09-05T00:49:21.460ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41162024-09-05T00:49:21.460ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41172024-09-05T00:49:21.465ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41182024-09-05T00:49:21.465ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41192024-09-05T00:49:21.467ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41202024-09-05T00:49:21.467ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41212024-09-05T00:49:21.468ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41222024-09-05T00:49:21.468ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41232024-09-05T00:49:21.470ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41242024-09-05T00:49:21.472ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2d4fccaa-0031-45b8-a053-9531608bab06, lookup_type: ById(2d4fccaa-0031-45b8-a053-9531608bab06) }, key: 43eeffc2-5843-4008-bed9-ec069e561096, lookup_type: ById(43eeffc2-5843-4008-bed9-ec069e561096) }, key: 4ff1e132-d479-46d8-a4e0-3ec93be9d815, lookup_type: ById(4ff1e132-d479-46d8-a4e0-3ec93be9d815) } result = Ok(()) saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41252024-09-05T00:49:21.473ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance updater_id = 967764e2-65c9-4144-9515-266bc4ffb610
41262024-09-05T00:49:21.473ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41272024-09-05T00:49:21.473ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41282024-09-05T00:49:21.489ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance updater_id = 967764e2-65c9-4144-9515-266bc4ffb610
41292024-09-05T00:49:21.489ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41302024-09-05T00:49:21.489ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance
41312024-09-05T00:49:21.493ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 locked_gen = Generation(Generation(2)) saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = LockInstance updater_id = 967764e2-65c9-4144-9515-266bc4ffb610
41322024-09-05T00:49:21.493ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41332024-09-05T00:49:21.493ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("967764e2-65c9-4144-9515-266bc4ffb610")}) node_id = 1 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683
41342024-09-05T00:49:21.499ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41352024-09-05T00:49:21.499ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683
41362024-09-05T00:49:21.507ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41372024-09-05T00:49:21.507ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41382024-09-05T00:49:21.509ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41392024-09-05T00:49:21.509ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41402024-09-05T00:49:21.510ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41412024-09-05T00:49:21.510ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41422024-09-05T00:49:21.511ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41432024-09-05T00:49:21.514ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2d4fccaa-0031-45b8-a053-9531608bab06, lookup_type: ById(2d4fccaa-0031-45b8-a053-9531608bab06) }, key: 43eeffc2-5843-4008-bed9-ec069e561096, lookup_type: ById(43eeffc2-5843-4008-bed9-ec069e561096) }, key: 4ff1e132-d479-46d8-a4e0-3ec93be9d815, lookup_type: ById(4ff1e132-d479-46d8-a4e0-3ec93be9d815) } result = Ok(()) saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41442024-09-05T00:49:21.514ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41452024-09-05T00:49:21.514ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41462024-09-05T00:49:21.519ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 74d206fd-7b85-46a8-90a5-4557f96d3a63, time_created: 2024-09-05T00:49:00.635406Z, time_deleted: None, instance_id: 4ff1e132-d479-46d8-a4e0-3ec93be9d815, sled_id: a014d257-275c-449e-a4f4-aef00eab141c, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-09-05T00:49:21.345972Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-09-05T00:49:00.694215Z, gen: Generation(Generation(3)), propolis_id: Some(74d206fd-7b85-46a8-90a5-4557f96d3a63), dst_propolis_id: None, migration_id: None, nexus_state: Vmm } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(74d206fd-7b85-46a8-90a5-4557f96d3a63 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-09-05T00:49:21.519898530Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm }
41472024-09-05T00:49:21.520ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update
41482024-09-05T00:49:21.523ZINFOnexus (SEC): saga create dag = {"end_node":13,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[12,0,null],[11,13,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"4ff1e132-d479-46d8-a4e0-3ec93be9d815","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"74d206fd-7b85-46a8-90a5-4557f96d3a63"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Start":{"params":{"authz_instance":{"key":"4ff1e132-d479-46d8-a4e0-3ec93be9d815","lookup_type":{"ById":"4ff1e132-d479-46d8-a4e0-3ec93be9d815"},"parent":{"key":"43eeffc2-5843-4008-bed9-ec069e561096","lookup_type":{"ById":"43eeffc2-5843-4008-bed9-ec069e561096"},"parent":{"key":"2d4fccaa-0031-45b8-a053-9531608bab06","lookup_type":{"ById":"2d4fccaa-0031-45b8-a053-9531608bab06"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"967764e2-65c9-4144-9515-266bc4ffb610"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"43eeffc2-5843-4008-bed9-ec069e561096","ram_diff":1073741824},"destroy_active_vmm":"74d206fd-7b85-46a8-90a5-4557f96d3a63","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_updated":"2024-09-05T00:49:21.519898530Z"}}}}},"End"]},"saga_name":"instance-update","start_node":12} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41492024-09-05T00:49:21.523ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update
41502024-09-05T00:49:21.554ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update
41512024-09-05T00:49:21.554ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41522024-09-05T00:49:21.554ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41532024-09-05T00:49:21.554ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
41542024-09-05T00:49:21.560ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41552024-09-05T00:49:21.560ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
41562024-09-05T00:49:21.566ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41572024-09-05T00:49:21.566ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
41582024-09-05T00:49:21.572ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41592024-09-05T00:49:21.572ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("a9323fb9-b19d-43c0-8938-22a6164764a7")) node_id = 0 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
41602024-09-05T00:49:21.578ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41612024-09-05T00:49:21.578ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
41622024-09-05T00:49:21.585ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 parent_lock = UpdaterLock { updater_id: 967764e2-65c9-4144-9515-266bc4ffb610, locked_gen: Generation(Generation(2)) } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update
41632024-09-05T00:49:21.585ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = BecomeUpdater
41642024-09-05T00:49:21.585ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = BecomeUpdater
41652024-09-05T00:49:21.598ZDEBGnexus (SagaExecutor): inherited lock from 967764e2-65c9-4144-9515-266bc4ffb610 to a9323fb9-b19d-43c0-8938-22a6164764a7 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 967764e2-65c9-4144-9515-266bc4ffb610 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = BecomeUpdater updater_id = a9323fb9-b19d-43c0-8938-22a6164764a7
41662024-09-05T00:49:21.598ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:932 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update
41672024-09-05T00:49:21.598ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41682024-09-05T00:49:21.598ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a9323fb9-b19d-43c0-8938-22a6164764a7")}) node_id = 1 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
41692024-09-05T00:49:21.604ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41702024-09-05T00:49:21.604ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
41712024-09-05T00:49:21.608ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41722024-09-05T00:49:21.608ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
41732024-09-05T00:49:21.633ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
41742024-09-05T00:49:21.633ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
41752024-09-05T00:49:21.638ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:985 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update
41762024-09-05T00:49:21.641ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815
41772024-09-05T00:49:21.643ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = UpdateNetworkConfig
41782024-09-05T00:49:21.643ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = UpdateNetworkConfig
41792024-09-05T00:49:21.645ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = UpdateNetworkConfig
41802024-09-05T00:49:21.645ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = UpdateNetworkConfig
41812024-09-05T00:49:21.647ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
41822024-09-05T00:49:21.647ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = UpdateNetworkConfig
41832024-09-05T00:49:21.648ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = UpdateNetworkConfig
41842024-09-05T00:49:21.650ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
41852024-09-05T00:49:21.650ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
41862024-09-05T00:49:21.650ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
41872024-09-05T00:49:21.651ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
41882024-09-05T00:49:21.652ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
41892024-09-05T00:49:21.652ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
41902024-09-05T00:49:21.652ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
41912024-09-05T00:49:21.657ZDEBGnexus: notifying dendrite of updates instance_id = Some(4ff1e132-d479-46d8-a4e0-3ec93be9d815 (instance)) switch = switch0
41922024-09-05T00:49:21.658ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3823, tv_nsec: 723335142 } })
41932024-09-05T00:49:21.659ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
41942024-09-05T00:49:21.690ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
41952024-09-05T00:49:21.690ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41962024-09-05T00:49:21.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f7d41532-7857-4ac8-85ff-926d6494baaa roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
41972024-09-05T00:49:21.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f7d41532-7857-4ac8-85ff-926d6494baaa resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
41982024-09-05T00:49:21.690ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7eeeccab-f9df-4367-aeb0-a0c729b32e9b", "content-length": "26", "date": "Thu, 05 Sep 2024 00:49:21 GMT"} })
41992024-09-05T00:49:21.690ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42002024-09-05T00:49:21.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f7d41532-7857-4ac8-85ff-926d6494baaa response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
42012024-09-05T00:49:21.692ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42022024-09-05T00:49:21.721ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
42032024-09-05T00:49:21.722ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "edff2093-cdd7-4ddd-ac80-dad6b863289c", "content-length": "4", "date": "Thu, 05 Sep 2024 00:49:21 GMT"} })
42042024-09-05T00:49:21.724ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42052024-09-05T00:49:21.724ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42062024-09-05T00:49:21.728ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42072024-09-05T00:49:21.728ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42082024-09-05T00:49:21.731ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
42092024-09-05T00:49:21.732ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
42102024-09-05T00:49:21.744ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1060 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-09-05T00:49:21.734608Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 2d4fccaa-0031-45b8-a053-9531608bab06, time_modified: Some(2024-09-05T00:49:21.734608Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 43eeffc2-5843-4008-bed9-ec069e561096, time_modified: Some(2024-09-05T00:49:21.734608Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update
42112024-09-05T00:49:21.744ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42122024-09-05T00:49:21.744ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42132024-09-05T00:49:21.746ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42142024-09-05T00:49:21.746ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42152024-09-05T00:49:21.750ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1095 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update
42162024-09-05T00:49:21.750ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = UnassignOximeterProducer
42172024-09-05T00:49:21.750ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = UnassignOximeterProducer
42182024-09-05T00:49:21.754ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 19d1dcd9-c605-423b-803d-56a986947027 producer_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update
42192024-09-05T00:49:21.754ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = UnassignOximeterProducer
42202024-09-05T00:49:21.754ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = UnassignOximeterProducer
42212024-09-05T00:49:21.787ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update
42222024-09-05T00:49:21.787ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/4ff1e132-d479-46d8-a4e0-3ec93be9d815
42232024-09-05T00:49:21.787ZDEBGnexus (SagaExecutor): client response oximeter-collector = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers/4ff1e132-d479-46d8-a4e0-3ec93be9d815", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6588a06a-b133-4462-ace4-52c87de90823", "date": "Thu, 05 Sep 2024 00:49:21 GMT"} }) saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update
42242024-09-05T00:49:21.787ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 19d1dcd9-c605-423b-803d-56a986947027 producer_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update
42252024-09-05T00:49:21.790ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42262024-09-05T00:49:21.790ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42272024-09-05T00:49:21.793ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42282024-09-05T00:49:21.793ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42292024-09-05T00:49:21.796ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 lock = UpdaterLock { updater_id: a9323fb9-b19d-43c0-8938-22a6164764a7, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-09-05T00:49:21.519898530Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update
42302024-09-05T00:49:21.796ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = CommitInstanceUpdates
42312024-09-05T00:49:21.796ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = CommitInstanceUpdates
42322024-09-05T00:49:21.837ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1144 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 new_runtime = InstanceRuntimeState { time_updated: 2024-09-05T00:49:21.519898530Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update
42332024-09-05T00:49:21.837ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = CommitInstanceUpdates
42342024-09-05T00:49:21.837ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Signaled
42352024-09-05T00:49:21.837ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42362024-09-05T00:49:21.838ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = CommitInstanceUpdates
42372024-09-05T00:49:21.838ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Signaled
42382024-09-05T00:49:21.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42392024-09-05T00:49:21.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42402024-09-05T00:49:21.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42412024-09-05T00:49:21.839ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = CommitInstanceUpdates
42422024-09-05T00:49:21.839ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = CommitInstanceUpdates
42432024-09-05T00:49:21.841ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = CommitInstanceUpdates
42442024-09-05T00:49:21.841ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = CommitInstanceUpdates
42452024-09-05T00:49:21.842ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = CommitInstanceUpdates
42462024-09-05T00:49:21.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42472024-09-05T00:49:21.846ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2d4fccaa-0031-45b8-a053-9531608bab06, lookup_type: ById(2d4fccaa-0031-45b8-a053-9531608bab06) }, key: 43eeffc2-5843-4008-bed9-ec069e561096, lookup_type: ById(43eeffc2-5843-4008-bed9-ec069e561096) }, key: 4ff1e132-d479-46d8-a4e0-3ec93be9d815, lookup_type: ById(4ff1e132-d479-46d8-a4e0-3ec93be9d815) } result = Ok(()) saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = CommitInstanceUpdates
42482024-09-05T00:49:21.846ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = CommitInstanceUpdates
42492024-09-05T00:49:21.846ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = CommitInstanceUpdates
42502024-09-05T00:49:21.847ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42512024-09-05T00:49:21.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42522024-09-05T00:49:21.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42532024-09-05T00:49:21.855ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42542024-09-05T00:49:21.855ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42552024-09-05T00:49:21.859ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42562024-09-05T00:49:21.859ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42572024-09-05T00:49:21.862ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42582024-09-05T00:49:21.862ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("4ff1e132-d479-46d8-a4e0-3ec93be9d815"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("74d206fd-7b85-46a8-90a5-4557f96d3a63")}) node_id = 7 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42592024-09-05T00:49:21.865ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42602024-09-05T00:49:21.866ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42612024-09-05T00:49:21.869ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42622024-09-05T00:49:21.869ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42632024-09-05T00:49:21.873ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42642024-09-05T00:49:21.873ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42652024-09-05T00:49:21.876ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update
42662024-09-05T00:49:21.876ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = ReleaseSledResources
42672024-09-05T00:49:21.876ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = ReleaseSledResources
42682024-09-05T00:49:21.881ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42692024-09-05T00:49:21.881ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42702024-09-05T00:49:21.881ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42712024-09-05T00:49:21.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42722024-09-05T00:49:21.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42732024-09-05T00:49:21.882ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42742024-09-05T00:49:21.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42752024-09-05T00:49:21.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42762024-09-05T00:49:21.884ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42772024-09-05T00:49:21.884ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42782024-09-05T00:49:21.889ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 propolis_id = 74d206fd-7b85-46a8-90a5-4557f96d3a63 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update
42792024-09-05T00:49:21.889ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = MarkVmmDeleted
42802024-09-05T00:49:21.890ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_node = MarkVmmDeleted
42812024-09-05T00:49:21.890ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42822024-09-05T00:49:21.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42832024-09-05T00:49:21.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42842024-09-05T00:49:21.893ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42852024-09-05T00:49:21.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42862024-09-05T00:49:21.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42872024-09-05T00:49:21.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42882024-09-05T00:49:21.896ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42892024-09-05T00:49:21.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42902024-09-05T00:49:21.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42912024-09-05T00:49:21.898ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42922024-09-05T00:49:21.898ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42932024-09-05T00:49:21.901ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42942024-09-05T00:49:21.901ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42952024-09-05T00:49:21.904ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42962024-09-05T00:49:21.904ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42972024-09-05T00:49:21.907ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
42982024-09-05T00:49:21.907ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
42992024-09-05T00:49:21.910ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
43002024-09-05T00:49:21.910ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
43012024-09-05T00:49:21.931ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43022024-09-05T00:49:21.932ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9c01201a-7823-401c-aa3f-a5cc747af872", "content-length": "691", "date": "Thu, 05 Sep 2024 00:49:21 GMT"} })
43032024-09-05T00:49:21.932ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
43042024-09-05T00:49:21.932ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
43052024-09-05T00:49:21.932ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
43062024-09-05T00:49:21.933ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 95.49489ms iteration = 15 status = {}
43072024-09-05T00:49:21.935ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
43082024-09-05T00:49:21.935ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04
43092024-09-05T00:49:21.942ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
43102024-09-05T00:49:21.942ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 saga_name = instance-update saga_result = SagaResult { saga_id: 4b01381c-033e-450d-afdb-9aee6fceac04, saga_log: SagaLog { saga_id: 4b01381c-033e-450d-afdb-9aee6fceac04, unwinding: false, events: [N012 started, N012 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N013 started, N013 succeeded], node_status: {0: Succeeded(String("a9323fb9-b19d-43c0-8938-22a6164764a7")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a9323fb9-b19d-43c0-8938-22a6164764a7")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("4ff1e132-d479-46d8-a4e0-3ec93be9d815"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("74d206fd-7b85-46a8-90a5-4557f96d3a63")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("4ff1e132-d479-46d8-a4e0-3ec93be9d815"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("74d206fd-7b85-46a8-90a5-4557f96d3a63")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("a9323fb9-b19d-43c0-8938-22a6164764a7"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("a9323fb9-b19d-43c0-8938-22a6164764a7")}} }) }
43112024-09-05T00:49:21.942ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 4b01381c-033e-450d-afdb-9aee6fceac04 instance_id = 4ff1e132-d479-46d8-a4e0-3ec93be9d815 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update
43122024-09-05T00:49:21.942ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
43132024-09-05T00:49:21.942ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683
43142024-09-05T00:49:21.945ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
43152024-09-05T00:49:21.945ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683
43162024-09-05T00:49:21.949ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
43172024-09-05T00:49:21.949ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683
43182024-09-05T00:49:21.953ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
43192024-09-05T00:49:21.953ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683
43202024-09-05T00:49:21.965ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43212024-09-05T00:49:21.965ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "33eb139d-f51e-43a6-aec0-20b78bb2869f", "content-length": "372", "date": "Thu, 05 Sep 2024 00:49:21 GMT"} })
43222024-09-05T00:49:21.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43232024-09-05T00:49:21.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43242024-09-05T00:49:21.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43252024-09-05T00:49:21.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43262024-09-05T00:49:21.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43272024-09-05T00:49:21.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43282024-09-05T00:49:21.973ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43292024-09-05T00:49:21.973ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0237057e-de97-4c0f-a7f4-77f391ec87f1", "date": "Thu, 05 Sep 2024 00:49:21 GMT"} })
43302024-09-05T00:49:21.974ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 136.587572ms iteration = 16 status = {}
43312024-09-05T00:49:22.000ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update sec_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
43322024-09-05T00:49:22.000ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = 6b6d88be-caec-45e6-a660-be6cbb976683 saga_name = start-instance-update saga_result = SagaResult { saga_id: 6b6d88be-caec-45e6-a660-be6cbb976683, saga_log: SagaLog { saga_id: 6b6d88be-caec-45e6-a660-be6cbb976683, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("967764e2-65c9-4144-9515-266bc4ffb610")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("967764e2-65c9-4144-9515-266bc4ffb610")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("967764e2-65c9-4144-9515-266bc4ffb610"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("967764e2-65c9-4144-9515-266bc4ffb610")}} }) }
43332024-09-05T00:49:22.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = e8a3c5ab-d118-4f08-b7cc-340fb7431e88 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
43342024-09-05T00:49:22.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = e8a3c5ab-d118-4f08-b7cc-340fb7431e88 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
43352024-09-05T00:49:22.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = e8a3c5ab-d118-4f08-b7cc-340fb7431e88 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
43362024-09-05T00:49:22.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 06061e2b-6006-4ef8-ac3b-205598cd3e8e roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43372024-09-05T00:49:22.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 06061e2b-6006-4ef8-ac3b-205598cd3e8e resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43382024-09-05T00:49:22.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 06061e2b-6006-4ef8-ac3b-205598cd3e8e response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43392024-09-05T00:49:23.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 31173fbd-4110-4a6a-a850-5440975ff0fc roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43402024-09-05T00:49:23.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 31173fbd-4110-4a6a-a850-5440975ff0fc resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43412024-09-05T00:49:23.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1767 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 31173fbd-4110-4a6a-a850-5440975ff0fc response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43422024-09-05T00:49:24.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1ef91a1c-6942-463d-91f9-0e51f89ad5fd roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43432024-09-05T00:49:24.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1ef91a1c-6942-463d-91f9-0e51f89ad5fd resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43442024-09-05T00:49:24.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1ef91a1c-6942-463d-91f9-0e51f89ad5fd response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43452024-09-05T00:49:24.956ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
43462024-09-05T00:49:24.956ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
43472024-09-05T00:49:24.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43482024-09-05T00:49:24.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43492024-09-05T00:49:24.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43502024-09-05T00:49:24.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43512024-09-05T00:49:24.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43522024-09-05T00:49:24.959ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43532024-09-05T00:49:24.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43542024-09-05T00:49:24.960ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.349937ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43552024-09-05T00:49:24.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43562024-09-05T00:49:24.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43572024-09-05T00:49:24.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43582024-09-05T00:49:24.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43592024-09-05T00:49:24.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43602024-09-05T00:49:24.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43612024-09-05T00:49:24.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
43622024-09-05T00:49:24.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43632024-09-05T00:49:24.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43642024-09-05T00:49:24.973ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
43652024-09-05T00:49:24.973ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.714848ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
43662024-09-05T00:49:25.169ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1784 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 2eaea28e-f87d-4686-affc-17e8369d4248 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
43672024-09-05T00:49:25.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 74e28de3-9a11-4fd4-af12-fcc6022edd69 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43682024-09-05T00:49:25.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 74e28de3-9a11-4fd4-af12-fcc6022edd69 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43692024-09-05T00:49:25.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 74e28de3-9a11-4fd4-af12-fcc6022edd69 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43702024-09-05T00:49:26.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8821625f-e5fe-4ee0-ba8c-571e1c68d069 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43712024-09-05T00:49:26.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8821625f-e5fe-4ee0-ba8c-571e1c68d069 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43722024-09-05T00:49:26.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8821625f-e5fe-4ee0-ba8c-571e1c68d069 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43732024-09-05T00:49:27.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 12d23538-e6fe-49d7-b314-1c5bba97f502 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43742024-09-05T00:49:27.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 12d23538-e6fe-49d7-b314-1c5bba97f502 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43752024-09-05T00:49:27.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2720 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 12d23538-e6fe-49d7-b314-1c5bba97f502 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43762024-09-05T00:49:28.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f2f57fcf-c52c-43ad-85a9-ba643032532d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43772024-09-05T00:49:28.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f2f57fcf-c52c-43ad-85a9-ba643032532d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43782024-09-05T00:49:28.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2471 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f2f57fcf-c52c-43ad-85a9-ba643032532d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43792024-09-05T00:49:29.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1ebc2b63-6652-4841-a1ac-c8ec3138e334 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43802024-09-05T00:49:29.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1ebc2b63-6652-4841-a1ac-c8ec3138e334 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43812024-09-05T00:49:29.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1ebc2b63-6652-4841-a1ac-c8ec3138e334 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43822024-09-05T00:49:30.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 03207ce9-71c2-490a-aa14-73c43ae161a9 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43832024-09-05T00:49:30.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 03207ce9-71c2-490a-aa14-73c43ae161a9 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43842024-09-05T00:49:30.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2561 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 03207ce9-71c2-490a-aa14-73c43ae161a9 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43852024-09-05T00:49:31.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8058e915-2950-475d-b04f-124b76dfc456 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43862024-09-05T00:49:31.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8058e915-2950-475d-b04f-124b76dfc456 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43872024-09-05T00:49:31.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8058e915-2950-475d-b04f-124b76dfc456 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43882024-09-05T00:49:32.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b050b175-a873-4e71-9af8-620b295fb53e roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43892024-09-05T00:49:32.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b050b175-a873-4e71-9af8-620b295fb53e resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43902024-09-05T00:49:32.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b050b175-a873-4e71-9af8-620b295fb53e response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43912024-09-05T00:49:33.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d8957715-5cbd-44f2-bad9-83fe5bc40f67 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43922024-09-05T00:49:33.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d8957715-5cbd-44f2-bad9-83fe5bc40f67 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43932024-09-05T00:49:33.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2581 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d8957715-5cbd-44f2-bad9-83fe5bc40f67 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
43942024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
43952024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43962024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
43972024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43982024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
43992024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
44002024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
44012024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44022024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
44032024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
44042024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
44052024-09-05T00:49:34.954ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-05 00:39:34.954502838 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
44062024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
44072024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
44082024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44092024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
44102024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
44112024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44122024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
44132024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44142024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
44152024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44162024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
44172024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44182024-09-05T00:49:34.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44192024-09-05T00:49:34.955ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
44202024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
44212024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
44222024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44232024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
44242024-09-05T00:49:34.956ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
44252024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44262024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44272024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
44282024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44292024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
44302024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
44312024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44322024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
44332024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
44342024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44352024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
44362024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44372024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44382024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
44392024-09-05T00:49:34.956ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59
44402024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
44412024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.981\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59"}
44422024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
44432024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44442024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
44452024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44462024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44472024-09-05T00:49:34.956ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("145d6d08-bb1c-4557-af3d-b3b8e647b114.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4aa18504-a7e8-4aa1-94fe-a65abab62a4b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("4aa18504-a7e8-4aa1-94fe-a65abab62a4b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3837, tv_nsec: 21616804 } })
44482024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44492024-09-05T00:49:34.956ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c51ae87-cbaf-4403-8e7a-91ae1f6a480f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89145bfe-85a8-47ae-9826-e73f4757fe92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("972980d1-78ce-4b3e-8b23-36e1a0e30ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("972980d1-78ce-4b3e-8b23-36e1a0e30ffb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 3837, tv_nsec: 21657735 } })
44502024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44512024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44522024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44532024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44542024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44552024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44562024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44572024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44582024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44592024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44602024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44612024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44622024-09-05T00:49:34.956ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44632024-09-05T00:49:34.958ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
44642024-09-05T00:49:34.958ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.800808ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
44652024-09-05T00:49:34.958ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44662024-09-05T00:49:34.958ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44672024-09-05T00:49:34.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44682024-09-05T00:49:34.959ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44692024-09-05T00:49:34.959ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
44702024-09-05T00:49:34.959ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.807615ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
44712024-09-05T00:49:34.959ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3837, tv_nsec: 24542346 } })
44722024-09-05T00:49:34.959ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-05 00:39:34.954502838 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
44732024-09-05T00:49:34.959ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.937128ms iteration = 8 status = {"expiration":"2024-09-05T00:39:34.954502838Z","pruned":[]}
44742024-09-05T00:49:34.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44752024-09-05T00:49:34.960ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
44762024-09-05T00:49:34.960ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44772024-09-05T00:49:34.960ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
44782024-09-05T00:49:34.960ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
44792024-09-05T00:49:34.960ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
44802024-09-05T00:49:34.960ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
44812024-09-05T00:49:34.960ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
44822024-09-05T00:49:34.960ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
44832024-09-05T00:49:34.960ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44842024-09-05T00:49:34.960ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
44852024-09-05T00:49:34.960ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
44862024-09-05T00:49:34.960ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44872024-09-05T00:49:34.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44882024-09-05T00:49:34.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
44892024-09-05T00:49:34.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44902024-09-05T00:49:34.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44912024-09-05T00:49:34.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
44922024-09-05T00:49:34.960ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
44932024-09-05T00:49:34.960ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3837, tv_nsec: 25998712 } })
44942024-09-05T00:49:34.961ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
44952024-09-05T00:49:34.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44962024-09-05T00:49:34.962ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.714379ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44972024-09-05T00:49:34.962ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44982024-09-05T00:49:34.962ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44992024-09-05T00:49:34.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45002024-09-05T00:49:34.963ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45012024-09-05T00:49:34.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45022024-09-05T00:49:34.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45032024-09-05T00:49:34.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
45042024-09-05T00:49:34.964ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
45052024-09-05T00:49:34.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
45062024-09-05T00:49:34.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45072024-09-05T00:49:34.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3e40b4a2-0e35-4300-b447-b9b3fcb41358 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
45082024-09-05T00:49:34.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3e40b4a2-0e35-4300-b447-b9b3fcb41358 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
45092024-09-05T00:49:34.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45102024-09-05T00:49:34.966ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45112024-09-05T00:49:34.966ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45122024-09-05T00:49:34.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45132024-09-05T00:49:34.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45142024-09-05T00:49:34.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45152024-09-05T00:49:34.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45162024-09-05T00:49:34.970ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45172024-09-05T00:49:34.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
45182024-09-05T00:49:34.970ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45192024-09-05T00:49:34.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45202024-09-05T00:49:34.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45212024-09-05T00:49:34.970ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45222024-09-05T00:49:34.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45232024-09-05T00:49:34.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45242024-09-05T00:49:34.972ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45252024-09-05T00:49:34.972ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45262024-09-05T00:49:34.972ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.661606ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
45272024-09-05T00:49:34.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45282024-09-05T00:49:34.974ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
45292024-09-05T00:49:34.974ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
45302024-09-05T00:49:34.974ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.244664ms iteration = 8 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
45312024-09-05T00:49:34.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45322024-09-05T00:49:34.977ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.722486ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45332024-09-05T00:49:34.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45342024-09-05T00:49:34.978ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.209934ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
45352024-09-05T00:49:34.979ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45362024-09-05T00:49:34.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45372024-09-05T00:49:34.980ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45382024-09-05T00:49:34.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 14224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3e40b4a2-0e35-4300-b447-b9b3fcb41358 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
45392024-09-05T00:49:34.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45402024-09-05T00:49:34.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45412024-09-05T00:49:34.980ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45422024-09-05T00:49:34.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45432024-09-05T00:49:34.982ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3837, tv_nsec: 47497155 } })
45442024-09-05T00:49:34.982ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45452024-09-05T00:49:34.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45462024-09-05T00:49:34.983ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45472024-09-05T00:49:34.983ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
45482024-09-05T00:49:34.985ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
45492024-09-05T00:49:34.985ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45502024-09-05T00:49:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45512024-09-05T00:49:34.995ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45522024-09-05T00:49:34.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45532024-09-05T00:49:34.996ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
45542024-09-05T00:49:34.996ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45552024-09-05T00:49:34.996ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45562024-09-05T00:49:34.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45572024-09-05T00:49:35.001ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
45582024-09-05T00:49:35.001ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.765957ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
45592024-09-05T00:49:35.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45602024-09-05T00:49:35.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45612024-09-05T00:49:35.007ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45622024-09-05T00:49:35.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45632024-09-05T00:49:35.008ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45642024-09-05T00:49:35.009ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45652024-09-05T00:49:35.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45662024-09-05T00:49:35.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45672024-09-05T00:49:35.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45682024-09-05T00:49:35.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45692024-09-05T00:49:35.015ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
45702024-09-05T00:49:35.015ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
45712024-09-05T00:49:35.015ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
45722024-09-05T00:49:35.015ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45732024-09-05T00:49:35.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45742024-09-05T00:49:35.020ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45752024-09-05T00:49:35.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45762024-09-05T00:49:35.021ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45772024-09-05T00:49:35.021ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
45782024-09-05T00:49:35.021ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
45792024-09-05T00:49:35.021ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
45802024-09-05T00:49:35.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45812024-09-05T00:49:35.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45822024-09-05T00:49:35.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45832024-09-05T00:49:35.022ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
45842024-09-05T00:49:35.022ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
45852024-09-05T00:49:35.022ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 66.354191ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
45862024-09-05T00:49:35.023ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45872024-09-05T00:49:35.025ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45882024-09-05T00:49:35.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45892024-09-05T00:49:35.027ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45902024-09-05T00:49:35.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45912024-09-05T00:49:35.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
45922024-09-05T00:49:35.028ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45932024-09-05T00:49:35.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45942024-09-05T00:49:35.102ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
45952024-09-05T00:49:35.110ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
45962024-09-05T00:49:35.152ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45972024-09-05T00:49:35.155ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45982024-09-05T00:49:35.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45992024-09-05T00:49:35.157ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46002024-09-05T00:49:35.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46012024-09-05T00:49:35.160ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46022024-09-05T00:49:35.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46032024-09-05T00:49:35.169ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = c2243d7f-cdb8-4922-99cd-004d92b6db85 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
46042024-09-05T00:49:35.192ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 236.446309ms iteration = 15 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
46052024-09-05T00:49:35.193ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46062024-09-05T00:49:35.195ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 235.033493ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
46072024-09-05T00:49:35.195ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46082024-09-05T00:49:35.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a014d257-275c-449e-a4f4-aef00eab141c, lookup_type: ById(a014d257-275c-449e-a4f4-aef00eab141c) } result = Ok(())
46092024-09-05T00:49:35.195ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46102024-09-05T00:49:35.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46112024-09-05T00:49:35.197ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 241.417987ms iteration = 15 status = 0
46122024-09-05T00:49:35.199ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46132024-09-05T00:49:35.199ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
46142024-09-05T00:49:35.199ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46152024-09-05T00:49:35.199ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 242.914834ms iteration = 15 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
46162024-09-05T00:49:35.199ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46172024-09-05T00:49:35.199ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46182024-09-05T00:49:35.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46192024-09-05T00:49:35.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46202024-09-05T00:49:35.199ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46212024-09-05T00:49:35.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46222024-09-05T00:49:35.201ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
46232024-09-05T00:49:35.201ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 59a6be26-b8fa-4e7a-8244-7a4e92426c26 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
46242024-09-05T00:49:35.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46252024-09-05T00:49:35.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46262024-09-05T00:49:35.203ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46272024-09-05T00:49:35.204ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46282024-09-05T00:49:35.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46292024-09-05T00:49:35.205ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46302024-09-05T00:49:35.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46312024-09-05T00:49:35.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46322024-09-05T00:49:35.213ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 59a6be26-b8fa-4e7a-8244-7a4e92426c26 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
46332024-09-05T00:49:35.213ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
46342024-09-05T00:49:35.213ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-05 00:42:43.011780 UTC dns_group = internal generation = 1
46352024-09-05T00:49:35.213ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 259.332926ms iteration = 9 status = {"generation":1}
46362024-09-05T00:49:35.226ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46372024-09-05T00:49:35.228ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46382024-09-05T00:49:35.228ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46392024-09-05T00:49:35.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46402024-09-05T00:49:35.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46412024-09-05T00:49:35.229ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
46422024-09-05T00:49:35.229ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46432024-09-05T00:49:35.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46442024-09-05T00:49:35.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46452024-09-05T00:49:35.231ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46462024-09-05T00:49:35.231ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46472024-09-05T00:49:35.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46482024-09-05T00:49:35.233ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
46492024-09-05T00:49:35.233ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 273.131632ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
46502024-09-05T00:49:35.234ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
46512024-09-05T00:49:35.234ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 278.510327ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
46522024-09-05T00:49:35.238ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
46532024-09-05T00:49:35.238ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 32541e10-8a85-4410-9858-67a9ab52251d dns_zone_name = oxide.test found_so_far = 0 version = 2
46542024-09-05T00:49:35.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46552024-09-05T00:49:35.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46562024-09-05T00:49:35.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46572024-09-05T00:49:35.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46582024-09-05T00:49:35.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46592024-09-05T00:49:35.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46602024-09-05T00:49:35.245ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 32541e10-8a85-4410-9858-67a9ab52251d dns_zone_name = oxide.test found_so_far = 1 version = 2
46612024-09-05T00:49:35.245ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
46622024-09-05T00:49:35.245ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-05 00:42:43.837540 UTC dns_group = external generation = 2
46632024-09-05T00:49:35.245ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 290.521222ms iteration = 9 status = {"generation":2}
46642024-09-05T00:49:35.251ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 295.658043ms iteration = 18 status = {"physical_disks_added":0}
46652024-09-05T00:49:35.262ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-05T00:42:33.143008Z, time_modified: 2024-09-05T00:42:33.143008Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2d4fccaa-0031-45b8-a053-9531608bab06, db_silo: Silo { identity: SiloIdentity { id: 2d4fccaa-0031-45b8-a053-9531608bab06, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-05T00:42:43.791199Z, time_modified: 2024-09-05T00:42:43.791199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2d4fccaa-0031-45b8-a053-9531608bab06, db_silo: Silo { identity: SiloIdentity { id: 2d4fccaa-0031-45b8-a053-9531608bab06, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-05T00:42:43.791199Z, time_modified: 2024-09-05T00:42:43.791199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
46662024-09-05T00:49:35.262ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 308.442781ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2d4fccaa-0031-45b8-a053-9531608bab06","tls_certs":["a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017"]}},"default_endpoint":{"silo_id":"2d4fccaa-0031-45b8-a053-9531608bab06","tls_certs":["a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
46672024-09-05T00:49:35.264ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
46682024-09-05T00:49:35.264ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1d93e460-e3fc-46ba-b113-1ca3cc4bccb1", "content-length": "372", "date": "Thu, 05 Sep 2024 00:49:35 GMT"} })
46692024-09-05T00:49:35.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46702024-09-05T00:49:35.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46712024-09-05T00:49:35.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46722024-09-05T00:49:35.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46732024-09-05T00:49:35.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46742024-09-05T00:49:35.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46752024-09-05T00:49:35.273ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46762024-09-05T00:49:35.273ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7487bda3-7ce8-4d6a-b865-1ad19cd43acf", "date": "Thu, 05 Sep 2024 00:49:35 GMT"} })
46772024-09-05T00:49:35.275ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 319.020019ms iteration = 17 status = {}
46782024-09-05T00:49:35.282ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
46792024-09-05T00:49:35.282ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5ed51d30-e78a-407d-a90d-c989faf5806b", "date": "Thu, 05 Sep 2024 00:49:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46802024-09-05T00:49:35.282ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46812024-09-05T00:49:35.283ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6dd8f653-062e-49df-9d3a-66783f4cfa81", "date": "Thu, 05 Sep 2024 00:49:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46822024-09-05T00:49:35.283ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46832024-09-05T00:49:35.286ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
46842024-09-05T00:49:35.286ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 331.608193ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
46852024-09-05T00:49:35.346ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
46862024-09-05T00:49:35.346ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46872024-09-05T00:49:35.347ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "88e3c82f-c47d-49ea-b103-8d943ca49261", "content-length": "26", "date": "Thu, 05 Sep 2024 00:49:34 GMT"} })
46882024-09-05T00:49:35.347ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46892024-09-05T00:49:35.348ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46902024-09-05T00:49:35.372ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
46912024-09-05T00:49:35.372ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46922024-09-05T00:49:35.372ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3f7f08c4-9cb5-4e29-a1fe-d405203c46ff", "content-length": "26", "date": "Thu, 05 Sep 2024 00:49:34 GMT"} })
46932024-09-05T00:49:35.372ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46942024-09-05T00:49:35.374ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46952024-09-05T00:49:35.383ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b zone_address = fd00:1122:3344:101::2
46962024-09-05T00:49:35.383ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46972024-09-05T00:49:35.384ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7c05f979-2a49-4025-9f14-c5c8565c9059", "content-length": "26", "date": "Thu, 05 Sep 2024 00:49:34 GMT"} })
46982024-09-05T00:49:35.384ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46992024-09-05T00:49:35.386ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
47002024-09-05T00:49:35.422ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
47012024-09-05T00:49:35.422ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8599576c-d2a8-492f-9cf8-e68a1f56b523", "date": "Thu, 05 Sep 2024 00:49:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
47022024-09-05T00:49:35.422ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
47032024-09-05T00:49:35.423ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f7b01174-9332-4f6a-a4a2-fd9c738fd9ab", "date": "Thu, 05 Sep 2024 00:49:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
47042024-09-05T00:49:35.423ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
47052024-09-05T00:49:35.425ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b330fac7-f63b-4dc8-b8c8-558f85495504", "date": "Thu, 05 Sep 2024 00:49:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
47062024-09-05T00:49:35.425ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
47072024-09-05T00:49:35.427ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
47082024-09-05T00:49:35.427ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 472.664195ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
47092024-09-05T00:49:35.432ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47102024-09-05T00:49:35.433ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7f5e9e1d-8502-4489-a000-26fbe82a930a", "content-length": "691", "date": "Thu, 05 Sep 2024 00:49:35 GMT"} })
47112024-09-05T00:49:35.433ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
47122024-09-05T00:49:35.433ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
47132024-09-05T00:49:35.433ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
47142024-09-05T00:49:35.435ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 478.983856ms iteration = 16 status = {}
47152024-09-05T00:49:35.463ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
47162024-09-05T00:49:35.463ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f7d71718-a863-4d64-9c01-b22d3b1ece93", "content-length": "2", "date": "Thu, 05 Sep 2024 00:49:35 GMT"} })
47172024-09-05T00:49:35.463ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47182024-09-05T00:49:35.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47192024-09-05T00:49:35.465ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 511.408544ms iteration = 15 status = null
47202024-09-05T00:49:35.481ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 526.795708ms iteration = 15 status = {}
47212024-09-05T00:49:35.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47222024-09-05T00:49:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47232024-09-05T00:49:35.539ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 3013d0b1-47fb-4df1-97e5-7049d1043033, rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c4762fe-488f-4054-979a-f54d371ea654) } rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
47242024-09-05T00:49:35.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47252024-09-05T00:49:35.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47262024-09-05T00:49:35.548ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
47272024-09-05T00:49:35.549ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "755d0384-2877-4843-9ae2-29256bd32523", "content-length": "121", "date": "Thu, 05 Sep 2024 00:49:35 GMT"} })
47282024-09-05T00:49:35.549ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
47292024-09-05T00:49:35.549ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c4762fe-488f-4054-979a-f54d371ea654
47302024-09-05T00:49:35.549ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
47312024-09-05T00:49:35.549ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
47322024-09-05T00:49:35.549ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
47332024-09-05T00:49:35.549ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
47342024-09-05T00:49:35.549ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
47352024-09-05T00:49:35.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47362024-09-05T00:49:35.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47372024-09-05T00:49:35.551ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
47382024-09-05T00:49:35.551ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ac5cba6f-7327-49d6-8e3e-bad7fc538a22", "content-length": "2", "date": "Thu, 05 Sep 2024 00:49:35 GMT"} })
47392024-09-05T00:49:35.551ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
47402024-09-05T00:49:35.551ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "901f2ee5-82f7-4345-ae42-8c0695772505", "content-length": "51", "date": "Thu, 05 Sep 2024 00:49:35 GMT"} })
47412024-09-05T00:49:35.551ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
47422024-09-05T00:49:35.551ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
47432024-09-05T00:49:35.638ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "518c7116-48ec-4d1b-9734-dabe7af57b46", "date": "Thu, 05 Sep 2024 00:49:35 GMT"} })
47442024-09-05T00:49:35.638ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch = Switch0
47452024-09-05T00:49:35.638ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
47462024-09-05T00:49:35.638ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a2d90c12-71c4-4e31-9318-3d957cca5b2c", "content-length": "667", "date": "Thu, 05 Sep 2024 00:49:35 GMT"} })
47472024-09-05T00:49:35.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47482024-09-05T00:49:35.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47492024-09-05T00:49:35.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47502024-09-05T00:49:35.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47512024-09-05T00:49:35.646ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47522024-09-05T00:49:35.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47532024-09-05T00:49:35.648ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47542024-09-05T00:49:35.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47552024-09-05T00:49:35.654ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 698.136869ms iteration = 15 status = {}
47562024-09-05T00:49:36.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1abaf17d-6f8c-4eb6-bccf-e953b24f805a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47572024-09-05T00:49:36.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1abaf17d-6f8c-4eb6-bccf-e953b24f805a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47582024-09-05T00:49:36.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2499 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1abaf17d-6f8c-4eb6-bccf-e953b24f805a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47592024-09-05T00:49:37.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1b51036a-af02-4713-b5c1-3b36f5fc56b2 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47602024-09-05T00:49:37.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1b51036a-af02-4713-b5c1-3b36f5fc56b2 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47612024-09-05T00:49:37.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1b51036a-af02-4713-b5c1-3b36f5fc56b2 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47622024-09-05T00:49:38.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2f7c94c9-0a8e-4af0-be29-02efbd263234 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47632024-09-05T00:49:38.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2f7c94c9-0a8e-4af0-be29-02efbd263234 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47642024-09-05T00:49:38.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2705 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2f7c94c9-0a8e-4af0-be29-02efbd263234 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47652024-09-05T00:49:39.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 37badf1b-06da-40f9-b697-01d9c023b763 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47662024-09-05T00:49:39.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 37badf1b-06da-40f9-b697-01d9c023b763 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47672024-09-05T00:49:39.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 37badf1b-06da-40f9-b697-01d9c023b763 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47682024-09-05T00:49:40.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7a92d487-89f2-4b74-a85a-9030fe388f5a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47692024-09-05T00:49:40.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7a92d487-89f2-4b74-a85a-9030fe388f5a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47702024-09-05T00:49:40.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7a92d487-89f2-4b74-a85a-9030fe388f5a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47712024-09-05T00:49:41.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5b378f1a-5c6d-41eb-a83e-a277dfc47abb roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47722024-09-05T00:49:41.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5b378f1a-5c6d-41eb-a83e-a277dfc47abb resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47732024-09-05T00:49:41.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5b378f1a-5c6d-41eb-a83e-a277dfc47abb response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47742024-09-05T00:49:42.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7944acc4-4d97-4c03-b65d-e3f4dde60683 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47752024-09-05T00:49:42.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7944acc4-4d97-4c03-b65d-e3f4dde60683 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47762024-09-05T00:49:42.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7944acc4-4d97-4c03-b65d-e3f4dde60683 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47772024-09-05T00:49:43.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 97c8c835-e113-41a1-a5ff-aa08759ce491 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47782024-09-05T00:49:43.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 97c8c835-e113-41a1-a5ff-aa08759ce491 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47792024-09-05T00:49:43.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 97c8c835-e113-41a1-a5ff-aa08759ce491 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47802024-09-05T00:49:44.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2c5e85e7-9e40-4857-936f-5b3225297d6b roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47812024-09-05T00:49:44.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2c5e85e7-9e40-4857-936f-5b3225297d6b resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47822024-09-05T00:49:44.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2c5e85e7-9e40-4857-936f-5b3225297d6b response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
47832024-09-05T00:49:44.956ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
47842024-09-05T00:49:44.956ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
47852024-09-05T00:49:44.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47862024-09-05T00:49:44.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47872024-09-05T00:49:44.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47882024-09-05T00:49:44.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47892024-09-05T00:49:44.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47902024-09-05T00:49:44.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47912024-09-05T00:49:44.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47922024-09-05T00:49:44.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47932024-09-05T00:49:44.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47942024-09-05T00:49:44.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47952024-09-05T00:49:44.967ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47962024-09-05T00:49:44.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
47972024-09-05T00:49:44.970ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47982024-09-05T00:49:44.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47992024-09-05T00:49:44.978ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
48002024-09-05T00:49:44.978ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.091113ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
48012024-09-05T00:49:44.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48022024-09-05T00:49:44.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48032024-09-05T00:49:44.990ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.084957ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48042024-09-05T00:49:45.169ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1669 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = b99c6b23-0ed0-4e5c-99fa-5cd0e73402e0 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
48052024-09-05T00:49:45.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8f978af6-44f6-45a2-bbe5-37771af2aac4 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48062024-09-05T00:49:45.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8f978af6-44f6-45a2-bbe5-37771af2aac4 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48072024-09-05T00:49:45.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1844 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8f978af6-44f6-45a2-bbe5-37771af2aac4 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48082024-09-05T00:49:46.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a62c7ea5-7b96-43fd-8f58-2ae6eb9553bc roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48092024-09-05T00:49:46.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a62c7ea5-7b96-43fd-8f58-2ae6eb9553bc resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48102024-09-05T00:49:46.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a62c7ea5-7b96-43fd-8f58-2ae6eb9553bc response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48112024-09-05T00:49:47.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e982a0a4-eb1b-4bbd-9d1b-ab6c86cbe778 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48122024-09-05T00:49:47.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e982a0a4-eb1b-4bbd-9d1b-ab6c86cbe778 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48132024-09-05T00:49:47.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e982a0a4-eb1b-4bbd-9d1b-ab6c86cbe778 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48142024-09-05T00:49:48.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 335dfd42-e895-4028-9265-c9ef758e72e9 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48152024-09-05T00:49:48.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 335dfd42-e895-4028-9265-c9ef758e72e9 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48162024-09-05T00:49:48.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 335dfd42-e895-4028-9265-c9ef758e72e9 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48172024-09-05T00:49:49.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 94298040-277b-4961-9d5c-39d6f392a3ef roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48182024-09-05T00:49:49.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 94298040-277b-4961-9d5c-39d6f392a3ef resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48192024-09-05T00:49:49.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2764 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 94298040-277b-4961-9d5c-39d6f392a3ef response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48202024-09-05T00:49:50.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 77416943-adcc-44e3-812a-b1649826359d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48212024-09-05T00:49:50.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 77416943-adcc-44e3-812a-b1649826359d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48222024-09-05T00:49:50.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 77416943-adcc-44e3-812a-b1649826359d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48232024-09-05T00:49:51.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8b57f63d-b6de-4714-b5e8-9337971d2ea2 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48242024-09-05T00:49:51.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8b57f63d-b6de-4714-b5e8-9337971d2ea2 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48252024-09-05T00:49:51.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8b57f63d-b6de-4714-b5e8-9337971d2ea2 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48262024-09-05T00:49:52.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4c2e276c-7bde-453d-a060-45f6ea0fdff4 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48272024-09-05T00:49:52.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4c2e276c-7bde-453d-a060-45f6ea0fdff4 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48282024-09-05T00:49:52.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4c2e276c-7bde-453d-a060-45f6ea0fdff4 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48292024-09-05T00:49:52.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = b5099a75-6fce-4109-834c-79901e52befa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
48302024-09-05T00:49:52.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = b5099a75-6fce-4109-834c-79901e52befa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
48312024-09-05T00:49:52.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = b5099a75-6fce-4109-834c-79901e52befa response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
48322024-09-05T00:49:53.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e70951ce-1c47-4967-ac40-16bc152806b2 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48332024-09-05T00:49:53.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e70951ce-1c47-4967-ac40-16bc152806b2 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48342024-09-05T00:49:53.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e70951ce-1c47-4967-ac40-16bc152806b2 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48352024-09-05T00:49:54.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3d23fc1c-77d5-44c1-b4ab-a51674e13249 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48362024-09-05T00:49:54.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3d23fc1c-77d5-44c1-b4ab-a51674e13249 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48372024-09-05T00:49:54.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3d23fc1c-77d5-44c1-b4ab-a51674e13249 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48382024-09-05T00:49:54.957ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
48392024-09-05T00:49:54.957ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
48402024-09-05T00:49:54.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48412024-09-05T00:49:54.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48422024-09-05T00:49:54.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48432024-09-05T00:49:54.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48442024-09-05T00:49:54.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48452024-09-05T00:49:54.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48462024-09-05T00:49:54.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48472024-09-05T00:49:54.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48482024-09-05T00:49:54.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48492024-09-05T00:49:54.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48502024-09-05T00:49:54.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48512024-09-05T00:49:54.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
48522024-09-05T00:49:54.967ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48532024-09-05T00:49:54.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48542024-09-05T00:49:54.976ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
48552024-09-05T00:49:54.976ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.846623ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
48562024-09-05T00:49:54.983ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48572024-09-05T00:49:54.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48582024-09-05T00:49:55.009ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.521276ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48592024-09-05T00:49:55.170ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2462 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 56d656c7-02c5-40fb-8408-6fd298ec678c response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
48602024-09-05T00:49:55.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 52250888-ac4d-44df-bf59-29f4176d4a7b roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48612024-09-05T00:49:55.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 52250888-ac4d-44df-bf59-29f4176d4a7b resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48622024-09-05T00:49:55.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 52250888-ac4d-44df-bf59-29f4176d4a7b response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48632024-09-05T00:49:56.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d4c6964e-075d-4f14-b72f-4ed2c5c36fd4 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48642024-09-05T00:49:56.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d4c6964e-075d-4f14-b72f-4ed2c5c36fd4 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48652024-09-05T00:49:56.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d4c6964e-075d-4f14-b72f-4ed2c5c36fd4 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48662024-09-05T00:49:57.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 838e450e-b64f-4c62-96e1-27ce21560e5d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48672024-09-05T00:49:57.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 838e450e-b64f-4c62-96e1-27ce21560e5d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48682024-09-05T00:49:57.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 838e450e-b64f-4c62-96e1-27ce21560e5d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48692024-09-05T00:49:58.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6388b87c-29ec-4977-85ad-272c3bcd9fc9 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48702024-09-05T00:49:58.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6388b87c-29ec-4977-85ad-272c3bcd9fc9 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48712024-09-05T00:49:58.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6388b87c-29ec-4977-85ad-272c3bcd9fc9 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48722024-09-05T00:49:59.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 53849451-c733-4237-87aa-07726c07c8a0 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48732024-09-05T00:49:59.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 53849451-c733-4237-87aa-07726c07c8a0 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48742024-09-05T00:49:59.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2095 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 53849451-c733-4237-87aa-07726c07c8a0 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48752024-09-05T00:50:00.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a06fa784-3596-4093-9d72-d9024fb0b88c roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48762024-09-05T00:50:00.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a06fa784-3596-4093-9d72-d9024fb0b88c resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48772024-09-05T00:50:00.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a06fa784-3596-4093-9d72-d9024fb0b88c response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48782024-09-05T00:50:01.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4c3a3b75-fdbb-48d1-93d2-eb86915b0cf3 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48792024-09-05T00:50:01.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4c3a3b75-fdbb-48d1-93d2-eb86915b0cf3 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48802024-09-05T00:50:01.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4c3a3b75-fdbb-48d1-93d2-eb86915b0cf3 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48812024-09-05T00:50:02.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 171a238d-685a-4178-9ab8-ac7a98fc5e1c roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48822024-09-05T00:50:02.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 171a238d-685a-4178-9ab8-ac7a98fc5e1c resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48832024-09-05T00:50:02.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 171a238d-685a-4178-9ab8-ac7a98fc5e1c response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48842024-09-05T00:50:03.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9840d7b3-9ee7-49b4-8194-3725829b8a3a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48852024-09-05T00:50:03.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9840d7b3-9ee7-49b4-8194-3725829b8a3a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48862024-09-05T00:50:03.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9840d7b3-9ee7-49b4-8194-3725829b8a3a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48872024-09-05T00:50:04.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0919bf53-a254-43aa-bd22-56802ae1738a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48882024-09-05T00:50:04.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0919bf53-a254-43aa-bd22-56802ae1738a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48892024-09-05T00:50:04.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0919bf53-a254-43aa-bd22-56802ae1738a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
48902024-09-05T00:50:04.955ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
48912024-09-05T00:50:04.955ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48922024-09-05T00:50:04.955ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
48932024-09-05T00:50:04.955ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48942024-09-05T00:50:04.955ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
48952024-09-05T00:50:04.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
48962024-09-05T00:50:04.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48972024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
48982024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
48992024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49002024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49012024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49022024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
49032024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
49042024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49052024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49062024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
49072024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49082024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
49092024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
49102024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49112024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49122024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
49132024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49142024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
49152024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
49162024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49172024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49182024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49192024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49202024-09-05T00:50:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49212024-09-05T00:50:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49222024-09-05T00:50:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49232024-09-05T00:50:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49242024-09-05T00:50:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49252024-09-05T00:50:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49262024-09-05T00:50:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49272024-09-05T00:50:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49282024-09-05T00:50:04.958ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3867, tv_nsec: 23475175 } })
49292024-09-05T00:50:04.959ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.588784ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49302024-09-05T00:50:04.959ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49312024-09-05T00:50:04.959ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
49322024-09-05T00:50:04.960ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3867, tv_nsec: 24953672 } })
49332024-09-05T00:50:04.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49342024-09-05T00:50:04.960ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49352024-09-05T00:50:04.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49362024-09-05T00:50:04.960ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
49372024-09-05T00:50:04.963ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49382024-09-05T00:50:04.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49392024-09-05T00:50:04.963ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49402024-09-05T00:50:04.963ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49412024-09-05T00:50:04.963ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49422024-09-05T00:50:04.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49432024-09-05T00:50:04.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49442024-09-05T00:50:04.963ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
49452024-09-05T00:50:04.963ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49462024-09-05T00:50:04.963ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
49472024-09-05T00:50:04.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49482024-09-05T00:50:04.963ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
49492024-09-05T00:50:04.963ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49502024-09-05T00:50:04.963ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
49512024-09-05T00:50:04.963ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
49522024-09-05T00:50:04.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49532024-09-05T00:50:04.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49542024-09-05T00:50:04.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49552024-09-05T00:50:04.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49562024-09-05T00:50:04.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49572024-09-05T00:50:04.964ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49582024-09-05T00:50:04.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49592024-09-05T00:50:04.970ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49602024-09-05T00:50:04.971ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3867, tv_nsec: 36524707 } })
49612024-09-05T00:50:04.971ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
49622024-09-05T00:50:04.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49632024-09-05T00:50:04.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49642024-09-05T00:50:04.973ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49652024-09-05T00:50:04.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49662024-09-05T00:50:04.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49672024-09-05T00:50:04.977ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49682024-09-05T00:50:04.978ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49692024-09-05T00:50:04.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49702024-09-05T00:50:04.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49712024-09-05T00:50:04.980ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49722024-09-05T00:50:04.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
49732024-09-05T00:50:04.983ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49742024-09-05T00:50:04.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49752024-09-05T00:50:04.992ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
49762024-09-05T00:50:04.992ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.222634ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
49772024-09-05T00:50:04.997ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49782024-09-05T00:50:04.998ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49792024-09-05T00:50:04.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49802024-09-05T00:50:04.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49812024-09-05T00:50:04.999ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49822024-09-05T00:50:04.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49832024-09-05T00:50:05.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49842024-09-05T00:50:05.002ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49852024-09-05T00:50:05.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49862024-09-05T00:50:05.002ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49872024-09-05T00:50:05.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49882024-09-05T00:50:05.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49892024-09-05T00:50:05.003ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49902024-09-05T00:50:05.004ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
49912024-09-05T00:50:05.004ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49922024-09-05T00:50:05.004ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49932024-09-05T00:50:05.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49942024-09-05T00:50:05.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a014d257-275c-449e-a4f4-aef00eab141c, lookup_type: ById(a014d257-275c-449e-a4f4-aef00eab141c) } result = Ok(())
49952024-09-05T00:50:05.007ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49962024-09-05T00:50:05.007ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49972024-09-05T00:50:05.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49982024-09-05T00:50:05.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.930076ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49992024-09-05T00:50:05.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50002024-09-05T00:50:05.009ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50012024-09-05T00:50:05.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50022024-09-05T00:50:05.011ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 55.205343ms iteration = 16 status = 0
50032024-09-05T00:50:05.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.175946ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
50042024-09-05T00:50:05.013ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50052024-09-05T00:50:05.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50062024-09-05T00:50:05.016ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50072024-09-05T00:50:05.016ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.824086ms iteration = 16 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
50082024-09-05T00:50:05.017ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50092024-09-05T00:50:05.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50102024-09-05T00:50:05.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50112024-09-05T00:50:05.023ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50122024-09-05T00:50:05.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50132024-09-05T00:50:05.036ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50142024-09-05T00:50:05.036ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.825261ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50152024-09-05T00:50:05.038ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
50162024-09-05T00:50:05.038ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50172024-09-05T00:50:05.038ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 82.102131ms iteration = 16 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
50182024-09-05T00:50:05.051ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
50192024-09-05T00:50:05.051ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50202024-09-05T00:50:05.052ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "83b9d902-46ea-4ce6-aabd-091cc6a3c4cc", "content-length": "26", "date": "Thu, 05 Sep 2024 00:50:04 GMT"} })
50212024-09-05T00:50:05.052ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50222024-09-05T00:50:05.054ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50232024-09-05T00:50:05.054ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50242024-09-05T00:50:05.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50252024-09-05T00:50:05.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.616912ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50262024-09-05T00:50:05.061ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
50272024-09-05T00:50:05.061ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50282024-09-05T00:50:05.061ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "62bf2e95-1ed4-432e-a519-bcdd10923f52", "content-length": "26", "date": "Thu, 05 Sep 2024 00:50:04 GMT"} })
50292024-09-05T00:50:05.061ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50302024-09-05T00:50:05.064ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50312024-09-05T00:50:05.088ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50322024-09-05T00:50:05.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50332024-09-05T00:50:05.102ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 145.961438ms iteration = 19 status = {"physical_disks_added":0}
50342024-09-05T00:50:05.152ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b zone_address = fd00:1122:3344:101::2
50352024-09-05T00:50:05.152ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50362024-09-05T00:50:05.152ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1422cdca-7334-4b73-b874-4603ccf10b77", "content-length": "26", "date": "Thu, 05 Sep 2024 00:50:04 GMT"} })
50372024-09-05T00:50:05.152ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50382024-09-05T00:50:05.154ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
50392024-09-05T00:50:05.169ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1313 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 8d4475c1-c85d-4661-8248-ab0d843f8a03 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
50402024-09-05T00:50:05.174ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 219.332324ms iteration = 16 status = {}
50412024-09-05T00:50:05.176ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50422024-09-05T00:50:05.176ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c5ec6efd-822c-45be-82b3-13f01809efa7", "content-length": "2", "date": "Thu, 05 Sep 2024 00:50:05 GMT"} })
50432024-09-05T00:50:05.178ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50442024-09-05T00:50:05.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50452024-09-05T00:50:05.182ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50462024-09-05T00:50:05.185ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 229.721719ms iteration = 16 status = null
50472024-09-05T00:50:05.188ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7116919c-c2a6-44ab-b364-d8a2099f7e60", "content-length": "372", "date": "Thu, 05 Sep 2024 00:50:05 GMT"} })
50482024-09-05T00:50:05.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50492024-09-05T00:50:05.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50502024-09-05T00:50:05.194ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50512024-09-05T00:50:05.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50522024-09-05T00:50:05.198ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50532024-09-05T00:50:05.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50542024-09-05T00:50:05.202ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50552024-09-05T00:50:05.202ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c708c452-f228-4b61-865e-e225962ce93d", "date": "Thu, 05 Sep 2024 00:50:04 GMT"} })
50562024-09-05T00:50:05.203ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 247.20819ms iteration = 18 status = {}
50572024-09-05T00:50:05.213ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
50582024-09-05T00:50:05.213ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 250.042881ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
50592024-09-05T00:50:05.220ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50602024-09-05T00:50:05.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50612024-09-05T00:50:05.222ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50622024-09-05T00:50:05.223ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50632024-09-05T00:50:05.223ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50642024-09-05T00:50:05.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50652024-09-05T00:50:05.225ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50662024-09-05T00:50:05.227ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50672024-09-05T00:50:05.227ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50682024-09-05T00:50:05.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50692024-09-05T00:50:05.266ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50702024-09-05T00:50:05.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50712024-09-05T00:50:05.268ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 3013d0b1-47fb-4df1-97e5-7049d1043033, rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c4762fe-488f-4054-979a-f54d371ea654) } rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
50722024-09-05T00:50:05.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50732024-09-05T00:50:05.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50742024-09-05T00:50:05.276ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50752024-09-05T00:50:05.276ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "297c61d2-c58e-4aca-82f5-1888f7dc022c", "content-length": "121", "date": "Thu, 05 Sep 2024 00:50:05 GMT"} })
50762024-09-05T00:50:05.276ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
50772024-09-05T00:50:05.276ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c4762fe-488f-4054-979a-f54d371ea654
50782024-09-05T00:50:05.277ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50792024-09-05T00:50:05.277ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50802024-09-05T00:50:05.277ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
50812024-09-05T00:50:05.277ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
50822024-09-05T00:50:05.277ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
50832024-09-05T00:50:05.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50842024-09-05T00:50:05.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50852024-09-05T00:50:05.282ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
50862024-09-05T00:50:05.283ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ed93fff2-3d59-4fe2-8f7c-118036864f14", "content-length": "2", "date": "Thu, 05 Sep 2024 00:50:05 GMT"} })
50872024-09-05T00:50:05.283ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
50882024-09-05T00:50:05.283ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "70c026e5-cf07-4683-97c5-1ca0cc279556", "content-length": "51", "date": "Thu, 05 Sep 2024 00:50:05 GMT"} })
50892024-09-05T00:50:05.283ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
50902024-09-05T00:50:05.283ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
50912024-09-05T00:50:05.307ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50922024-09-05T00:50:05.378ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "adcac55f-bcfa-4caa-bdea-14292d3db6c3", "date": "Thu, 05 Sep 2024 00:50:04 GMT"} })
50932024-09-05T00:50:05.378ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch = Switch0
50942024-09-05T00:50:05.378ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
50952024-09-05T00:50:05.379ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bf2c2965-3778-46f9-bead-d58c0e0c7aeb", "content-length": "667", "date": "Thu, 05 Sep 2024 00:50:04 GMT"} })
50962024-09-05T00:50:05.379ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50972024-09-05T00:50:05.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50982024-09-05T00:50:05.379ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "85a45353-0fc0-4d81-b59d-7e454f5a6784", "content-length": "691", "date": "Thu, 05 Sep 2024 00:50:05 GMT"} })
50992024-09-05T00:50:05.379ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
51002024-09-05T00:50:05.379ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
51012024-09-05T00:50:05.379ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
51022024-09-05T00:50:05.381ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 424.417146ms iteration = 17 status = {}
51032024-09-05T00:50:05.382ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51042024-09-05T00:50:05.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51052024-09-05T00:50:05.386ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51062024-09-05T00:50:05.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51072024-09-05T00:50:05.388ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51082024-09-05T00:50:05.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51092024-09-05T00:50:05.394ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 438.307833ms iteration = 16 status = {}
51102024-09-05T00:50:05.559ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:56782
51112024-09-05T00:50:05.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56782 req_id = d6b15c1f-6ce4-4099-8f74-e1b955d52df9 roles = RoleSet { roles: {} } uri = /metrics/producers
51122024-09-05T00:50:05.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56782 req_id = d6b15c1f-6ce4-4099-8f74-e1b955d52df9 resource = Database result = Ok(()) uri = /metrics/producers
51132024-09-05T00:50:05.592ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
51142024-09-05T00:50:05.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56782 req_id = d6b15c1f-6ce4-4099-8f74-e1b955d52df9 roles = RoleSet { roles: {} } uri = /metrics/producers
51152024-09-05T00:50:05.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56782 req_id = d6b15c1f-6ce4-4099-8f74-e1b955d52df9 resource = Database result = Ok(()) uri = /metrics/producers
51162024-09-05T00:50:05.622ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
51172024-09-05T00:50:05.622ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "15a8846d-b90c-4837-8dc5-387d6cd5907b", "date": "Thu, 05 Sep 2024 00:50:05 GMT"} })
51182024-09-05T00:50:05.622ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = c2d58162-25ee-4e2a-9e85-e5ea2d681d4d
51192024-09-05T00:50:05.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 64982 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56782 req_id = d6b15c1f-6ce4-4099-8f74-e1b955d52df9 response_code = 201 uri = /metrics/producers
51202024-09-05T00:50:05.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 50268e80-3133-4354-9fed-425d42151116 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51212024-09-05T00:50:05.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 50268e80-3133-4354-9fed-425d42151116 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51222024-09-05T00:50:05.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1681 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 50268e80-3133-4354-9fed-425d42151116 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51232024-09-05T00:50:06.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2ca79b06-c994-4d84-bbb0-28ecf37ab6b9 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51242024-09-05T00:50:06.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2ca79b06-c994-4d84-bbb0-28ecf37ab6b9 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51252024-09-05T00:50:06.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2ca79b06-c994-4d84-bbb0-28ecf37ab6b9 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51262024-09-05T00:50:07.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4386de35-9294-4c8f-aaa2-16a60e93efeb roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51272024-09-05T00:50:07.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4386de35-9294-4c8f-aaa2-16a60e93efeb resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51282024-09-05T00:50:07.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4386de35-9294-4c8f-aaa2-16a60e93efeb response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51292024-09-05T00:50:08.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c17ce8f7-7db2-4e2e-b404-78e0a4588c01 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51302024-09-05T00:50:08.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c17ce8f7-7db2-4e2e-b404-78e0a4588c01 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51312024-09-05T00:50:08.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c17ce8f7-7db2-4e2e-b404-78e0a4588c01 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51322024-09-05T00:50:09.620ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:63202
51332024-09-05T00:50:09.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63202 req_id = 59d8afb0-78a9-4bb7-8331-b9f2ec8e5ddf roles = RoleSet { roles: {} } uri = /metrics/producers
51342024-09-05T00:50:09.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63202 req_id = 59d8afb0-78a9-4bb7-8331-b9f2ec8e5ddf resource = Database result = Ok(()) uri = /metrics/producers
51352024-09-05T00:50:09.656ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
51362024-09-05T00:50:09.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63202 req_id = 59d8afb0-78a9-4bb7-8331-b9f2ec8e5ddf roles = RoleSet { roles: {} } uri = /metrics/producers
51372024-09-05T00:50:09.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63202 req_id = 59d8afb0-78a9-4bb7-8331-b9f2ec8e5ddf resource = Database result = Ok(()) uri = /metrics/producers
51382024-09-05T00:50:09.694ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
51392024-09-05T00:50:09.694ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "aeee5fb8-be32-4bc4-8d89-78f0e3258ad1", "date": "Thu, 05 Sep 2024 00:50:09 GMT"} })
51402024-09-05T00:50:09.694ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = 9c3576f2-3ad5-4e30-a194-86e7ba23efdd
51412024-09-05T00:50:09.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 75274 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63202 req_id = 59d8afb0-78a9-4bb7-8331-b9f2ec8e5ddf response_code = 201 uri = /metrics/producers
51422024-09-05T00:50:09.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d1e38be4-2da0-4e9b-9118-f71863982308 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51432024-09-05T00:50:09.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d1e38be4-2da0-4e9b-9118-f71863982308 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51442024-09-05T00:50:09.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d1e38be4-2da0-4e9b-9118-f71863982308 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51452024-09-05T00:50:10.725ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:37866
51462024-09-05T00:50:10.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37866 req_id = a4dd5ec8-5ec6-4019-b10d-07789be07a4c roles = RoleSet { roles: {} } uri = /metrics/producers
51472024-09-05T00:50:10.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37866 req_id = a4dd5ec8-5ec6-4019-b10d-07789be07a4c resource = Database result = Ok(()) uri = /metrics/producers
51482024-09-05T00:50:10.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ff990446-2193-4407-b6d0-ce668b541be3 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51492024-09-05T00:50:10.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ff990446-2193-4407-b6d0-ce668b541be3 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51502024-09-05T00:50:10.758ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
51512024-09-05T00:50:10.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37866 req_id = a4dd5ec8-5ec6-4019-b10d-07789be07a4c roles = RoleSet { roles: {} } uri = /metrics/producers
51522024-09-05T00:50:10.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2826 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ff990446-2193-4407-b6d0-ce668b541be3 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51532024-09-05T00:50:10.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37866 req_id = a4dd5ec8-5ec6-4019-b10d-07789be07a4c resource = Database result = Ok(()) uri = /metrics/producers
51542024-09-05T00:50:10.766ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
51552024-09-05T00:50:10.766ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3ecaee13-fdd5-49b3-8946-fd770710c49c", "date": "Thu, 05 Sep 2024 00:50:10 GMT"} })
51562024-09-05T00:50:10.766ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = 35429cca-496a-49ba-952c-5eef2f1c42c8
51572024-09-05T00:50:10.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 43515 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37866 req_id = a4dd5ec8-5ec6-4019-b10d-07789be07a4c response_code = 201 uri = /metrics/producers
51582024-09-05T00:50:11.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bd8a4105-8da2-49b2-a7e3-8edef4fd4d6e roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51592024-09-05T00:50:11.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bd8a4105-8da2-49b2-a7e3-8edef4fd4d6e resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51602024-09-05T00:50:11.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bd8a4105-8da2-49b2-a7e3-8edef4fd4d6e response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51612024-09-05T00:50:12.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 24e850c3-ff98-4bcf-baaa-0f20eb9871a3 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51622024-09-05T00:50:12.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 24e850c3-ff98-4bcf-baaa-0f20eb9871a3 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51632024-09-05T00:50:12.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 24e850c3-ff98-4bcf-baaa-0f20eb9871a3 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51642024-09-05T00:50:13.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1e01474c-f943-49d8-b0d8-d7d0b73344bb roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51652024-09-05T00:50:13.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1e01474c-f943-49d8-b0d8-d7d0b73344bb resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51662024-09-05T00:50:13.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1938 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1e01474c-f943-49d8-b0d8-d7d0b73344bb response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51672024-09-05T00:50:14.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e73349e6-054b-461c-bb09-76f8d34bac16 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51682024-09-05T00:50:14.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e73349e6-054b-461c-bb09-76f8d34bac16 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51692024-09-05T00:50:14.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e73349e6-054b-461c-bb09-76f8d34bac16 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
51702024-09-05T00:50:14.956ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
51712024-09-05T00:50:14.956ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
51722024-09-05T00:50:14.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51732024-09-05T00:50:14.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51742024-09-05T00:50:14.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51752024-09-05T00:50:14.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51762024-09-05T00:50:14.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51772024-09-05T00:50:14.959ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51782024-09-05T00:50:14.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51792024-09-05T00:50:14.961ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.845916ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51802024-09-05T00:50:14.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51812024-09-05T00:50:14.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51822024-09-05T00:50:14.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51832024-09-05T00:50:14.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51842024-09-05T00:50:14.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51852024-09-05T00:50:14.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51862024-09-05T00:50:14.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
51872024-09-05T00:50:14.967ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51882024-09-05T00:50:14.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51892024-09-05T00:50:14.974ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
51902024-09-05T00:50:14.974ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.40851ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
51912024-09-05T00:50:15.170ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1854 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = f1b8b63d-5b7b-44c6-82ba-7c5e3b72fb76 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
51922024-09-05T00:50:15.171ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
51932024-09-05T00:50:15.171ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
51942024-09-05T00:50:15.202ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
51952024-09-05T00:50:15.202ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:38534
51962024-09-05T00:50:15.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38534 req_id = 36d8459e-2b54-4439-99dd-f80d7b66f590 roles = RoleSet { roles: {} } uri = /metrics/producers
51972024-09-05T00:50:15.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38534 req_id = 36d8459e-2b54-4439-99dd-f80d7b66f590 resource = Database result = Ok(()) uri = /metrics/producers
51982024-09-05T00:50:15.236ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
51992024-09-05T00:50:15.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38534 req_id = 36d8459e-2b54-4439-99dd-f80d7b66f590 roles = RoleSet { roles: {} } uri = /metrics/producers
52002024-09-05T00:50:15.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38534 req_id = 36d8459e-2b54-4439-99dd-f80d7b66f590 resource = Database result = Ok(()) uri = /metrics/producers
52012024-09-05T00:50:15.265ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
52022024-09-05T00:50:15.265ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5c48a87a-1846-4b3b-ac08-6ec716eea647", "date": "Thu, 05 Sep 2024 00:50:15 GMT"} })
52032024-09-05T00:50:15.265ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = 5f1fb376-349f-4b39-808a-5aa5abc60b1e
52042024-09-05T00:50:15.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 64791 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38534 req_id = 36d8459e-2b54-4439-99dd-f80d7b66f590 response_code = 201 uri = /metrics/producers
52052024-09-05T00:50:15.267ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "36d8459e-2b54-4439-99dd-f80d7b66f590", "content-length": "41", "date": "Thu, 05 Sep 2024 00:50:15 GMT"} })
52062024-09-05T00:50:15.269ZDEBGnexus (producer-registration-task): registered with nexus successfully
52072024-09-05T00:50:15.269ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
52082024-09-05T00:50:15.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a6627e20-fa3d-428a-90c7-9f9537a8a51e roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52092024-09-05T00:50:15.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a6627e20-fa3d-428a-90c7-9f9537a8a51e resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52102024-09-05T00:50:15.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a6627e20-fa3d-428a-90c7-9f9537a8a51e response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52112024-09-05T00:50:16.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 836c9b61-21e2-41e4-a70f-a0c61359c1e3 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52122024-09-05T00:50:16.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 836c9b61-21e2-41e4-a70f-a0c61359c1e3 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52132024-09-05T00:50:16.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 836c9b61-21e2-41e4-a70f-a0c61359c1e3 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52142024-09-05T00:50:17.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3cb542a1-24fd-4d92-bd04-2a6ffe0c4661 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52152024-09-05T00:50:17.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3cb542a1-24fd-4d92-bd04-2a6ffe0c4661 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52162024-09-05T00:50:17.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2715 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3cb542a1-24fd-4d92-bd04-2a6ffe0c4661 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52172024-09-05T00:50:18.740ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:46880
52182024-09-05T00:50:18.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46880 req_id = 9ec11175-840e-4536-ae89-3ef206edabff roles = RoleSet { roles: {} } uri = /metrics/producers
52192024-09-05T00:50:18.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46880 req_id = 9ec11175-840e-4536-ae89-3ef206edabff resource = Database result = Ok(()) uri = /metrics/producers
52202024-09-05T00:50:18.772ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
52212024-09-05T00:50:18.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46880 req_id = 9ec11175-840e-4536-ae89-3ef206edabff roles = RoleSet { roles: {} } uri = /metrics/producers
52222024-09-05T00:50:18.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46880 req_id = 9ec11175-840e-4536-ae89-3ef206edabff resource = Database result = Ok(()) uri = /metrics/producers
52232024-09-05T00:50:18.779ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
52242024-09-05T00:50:18.779ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6e7cd07c-37d4-4160-a5b0-ca5dfdf0a6af", "date": "Thu, 05 Sep 2024 00:50:18 GMT"} })
52252024-09-05T00:50:18.779ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = 42b3183c-16e5-4e5a-9353-cb1f595a1c67
52262024-09-05T00:50:18.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 41790 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46880 req_id = 9ec11175-840e-4536-ae89-3ef206edabff response_code = 201 uri = /metrics/producers
52272024-09-05T00:50:18.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4a66c1b7-b77d-4aea-8460-d92132ea901a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52282024-09-05T00:50:18.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4a66c1b7-b77d-4aea-8460-d92132ea901a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52292024-09-05T00:50:18.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4a66c1b7-b77d-4aea-8460-d92132ea901a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52302024-09-05T00:50:19.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b97761f4-00ac-4bc7-b76e-15901cfb184d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52312024-09-05T00:50:19.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b97761f4-00ac-4bc7-b76e-15901cfb184d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52322024-09-05T00:50:19.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b97761f4-00ac-4bc7-b76e-15901cfb184d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52332024-09-05T00:50:20.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4b424aa2-d234-445e-ba6b-c445252b349f roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52342024-09-05T00:50:20.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4b424aa2-d234-445e-ba6b-c445252b349f resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52352024-09-05T00:50:20.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4b424aa2-d234-445e-ba6b-c445252b349f response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52362024-09-05T00:50:21.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 85c13460-19e5-4bc2-8d76-04442753ba4f roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52372024-09-05T00:50:21.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 85c13460-19e5-4bc2-8d76-04442753ba4f resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52382024-09-05T00:50:21.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 85c13460-19e5-4bc2-8d76-04442753ba4f response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52392024-09-05T00:50:22.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 609786d7-db19-4f0a-9ede-f347d8283084 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
52402024-09-05T00:50:22.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 609786d7-db19-4f0a-9ede-f347d8283084 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
52412024-09-05T00:50:22.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 609786d7-db19-4f0a-9ede-f347d8283084 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
52422024-09-05T00:50:23.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1bb691b3-4ec7-47d4-b453-b585c0f68747 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52432024-09-05T00:50:23.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1bb691b3-4ec7-47d4-b453-b585c0f68747 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52442024-09-05T00:50:23.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1763 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1bb691b3-4ec7-47d4-b453-b585c0f68747 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52452024-09-05T00:50:24.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6b009f4e-e707-4e91-b449-5b4708460444 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52462024-09-05T00:50:24.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6b009f4e-e707-4e91-b449-5b4708460444 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52472024-09-05T00:50:24.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6b009f4e-e707-4e91-b449-5b4708460444 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52482024-09-05T00:50:24.956ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
52492024-09-05T00:50:24.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52502024-09-05T00:50:24.956ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
52512024-09-05T00:50:24.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52522024-09-05T00:50:24.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52532024-09-05T00:50:24.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52542024-09-05T00:50:24.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52552024-09-05T00:50:24.959ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52562024-09-05T00:50:24.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52572024-09-05T00:50:24.960ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.94095ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52582024-09-05T00:50:24.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52592024-09-05T00:50:24.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52602024-09-05T00:50:24.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52612024-09-05T00:50:24.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52622024-09-05T00:50:24.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52632024-09-05T00:50:24.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52642024-09-05T00:50:24.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
52652024-09-05T00:50:24.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52662024-09-05T00:50:24.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52672024-09-05T00:50:24.972ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
52682024-09-05T00:50:24.972ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.238089ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
52692024-09-05T00:50:25.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8f9ea91f-57c4-45ef-b2eb-771ecf57e30a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52702024-09-05T00:50:25.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8f9ea91f-57c4-45ef-b2eb-771ecf57e30a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52712024-09-05T00:50:25.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8f9ea91f-57c4-45ef-b2eb-771ecf57e30a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52722024-09-05T00:50:25.268ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1382 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 8a9f3a3f-7814-4ceb-b7e8-e70b9e9037c8 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
52732024-09-05T00:50:26.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6f5a1297-fdac-43dc-a57f-0862b85261b8 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52742024-09-05T00:50:26.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6f5a1297-fdac-43dc-a57f-0862b85261b8 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52752024-09-05T00:50:26.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6f5a1297-fdac-43dc-a57f-0862b85261b8 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52762024-09-05T00:50:27.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 00f4ac38-03c1-49ed-ab24-202937cfa163 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52772024-09-05T00:50:27.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 00f4ac38-03c1-49ed-ab24-202937cfa163 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52782024-09-05T00:50:27.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 00f4ac38-03c1-49ed-ab24-202937cfa163 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52792024-09-05T00:50:28.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1fffd68a-3ae8-44a0-a4e2-d0af49b11109 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52802024-09-05T00:50:28.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1fffd68a-3ae8-44a0-a4e2-d0af49b11109 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52812024-09-05T00:50:28.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1fffd68a-3ae8-44a0-a4e2-d0af49b11109 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52822024-09-05T00:50:29.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 326b6e4d-a218-43b6-9b31-499bd7b2504b roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52832024-09-05T00:50:29.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 326b6e4d-a218-43b6-9b31-499bd7b2504b resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52842024-09-05T00:50:29.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 326b6e4d-a218-43b6-9b31-499bd7b2504b response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52852024-09-05T00:50:30.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fc96b9b0-b801-4f83-b8aa-131a113c6ebf roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52862024-09-05T00:50:30.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fc96b9b0-b801-4f83-b8aa-131a113c6ebf resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52872024-09-05T00:50:30.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2668 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fc96b9b0-b801-4f83-b8aa-131a113c6ebf response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52882024-09-05T00:50:31.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 89768fa7-3794-40dd-9265-ea0891568c9f roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52892024-09-05T00:50:31.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 89768fa7-3794-40dd-9265-ea0891568c9f resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52902024-09-05T00:50:31.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 89768fa7-3794-40dd-9265-ea0891568c9f response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52912024-09-05T00:50:32.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4a6acaf0-9002-4448-8b3e-bc67c01d6ec1 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52922024-09-05T00:50:32.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4a6acaf0-9002-4448-8b3e-bc67c01d6ec1 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52932024-09-05T00:50:32.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1853 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4a6acaf0-9002-4448-8b3e-bc67c01d6ec1 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52942024-09-05T00:50:33.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2688efb5-75b4-4c24-92d1-0137bcd51ada roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52952024-09-05T00:50:33.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2688efb5-75b4-4c24-92d1-0137bcd51ada resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52962024-09-05T00:50:33.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2688efb5-75b4-4c24-92d1-0137bcd51ada response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52972024-09-05T00:50:34.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bd56dc32-e302-4df0-97ad-9bd408563634 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52982024-09-05T00:50:34.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bd56dc32-e302-4df0-97ad-9bd408563634 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
52992024-09-05T00:50:34.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bd56dc32-e302-4df0-97ad-9bd408563634 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
53002024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
53012024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
53022024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
53032024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
53042024-09-05T00:50:34.955ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-05 00:40:34.955710303 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
53052024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53062024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
53072024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
53082024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
53092024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53102024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
53112024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
53122024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53132024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
53142024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
53152024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53162024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
53172024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
53182024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53192024-09-05T00:50:34.955ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
53202024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53212024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53222024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
53232024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53242024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53252024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53262024-09-05T00:50:34.956ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("145d6d08-bb1c-4557-af3d-b3b8e647b114.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4aa18504-a7e8-4aa1-94fe-a65abab62a4b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("4aa18504-a7e8-4aa1-94fe-a65abab62a4b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3897, tv_nsec: 20985678 } })
53272024-09-05T00:50:34.956ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c51ae87-cbaf-4403-8e7a-91ae1f6a480f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89145bfe-85a8-47ae-9826-e73f4757fe92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("972980d1-78ce-4b3e-8b23-36e1a0e30ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("972980d1-78ce-4b3e-8b23-36e1a0e30ffb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 3897, tv_nsec: 21172131 } })
53282024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
53292024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
53302024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
53312024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53322024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53332024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53342024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
53352024-09-05T00:50:34.956ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
53362024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53372024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
53382024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
53392024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53402024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53412024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53422024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
53432024-09-05T00:50:34.956ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59
53442024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.76\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59"}
53452024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
53462024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
53472024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53482024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
53492024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53502024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53512024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
53522024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53532024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
53542024-09-05T00:50:34.956ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53552024-09-05T00:50:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53562024-09-05T00:50:34.957ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53572024-09-05T00:50:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53582024-09-05T00:50:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53592024-09-05T00:50:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53602024-09-05T00:50:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53612024-09-05T00:50:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53622024-09-05T00:50:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53632024-09-05T00:50:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53642024-09-05T00:50:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53652024-09-05T00:50:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53662024-09-05T00:50:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53672024-09-05T00:50:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53682024-09-05T00:50:34.957ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53692024-09-05T00:50:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53702024-09-05T00:50:34.959ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
53712024-09-05T00:50:34.959ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.494303ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
53722024-09-05T00:50:34.959ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
53732024-09-05T00:50:34.959ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.699186ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
53742024-09-05T00:50:34.959ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-05 00:40:34.955710303 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
53752024-09-05T00:50:34.959ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.157044ms iteration = 9 status = {"expiration":"2024-09-05T00:40:34.955710303Z","pruned":[]}
53762024-09-05T00:50:34.959ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.994361ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53772024-09-05T00:50:34.960ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3897, tv_nsec: 25294524 } })
53782024-09-05T00:50:34.960ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
53792024-09-05T00:50:34.960ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
53802024-09-05T00:50:34.960ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53812024-09-05T00:50:34.960ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53822024-09-05T00:50:34.960ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
53832024-09-05T00:50:34.960ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
53842024-09-05T00:50:34.960ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53852024-09-05T00:50:34.960ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
53862024-09-05T00:50:34.960ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
53872024-09-05T00:50:34.960ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
53882024-09-05T00:50:34.960ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
53892024-09-05T00:50:34.960ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
53902024-09-05T00:50:34.960ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53912024-09-05T00:50:34.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
53922024-09-05T00:50:34.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53932024-09-05T00:50:34.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53942024-09-05T00:50:34.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53952024-09-05T00:50:34.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
53962024-09-05T00:50:34.961ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3897, tv_nsec: 26376024 } })
53972024-09-05T00:50:34.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53982024-09-05T00:50:34.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53992024-09-05T00:50:34.961ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
54002024-09-05T00:50:34.962ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
54012024-09-05T00:50:34.963ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54022024-09-05T00:50:34.963ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54032024-09-05T00:50:34.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54042024-09-05T00:50:34.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54052024-09-05T00:50:34.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54062024-09-05T00:50:34.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54072024-09-05T00:50:34.964ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54082024-09-05T00:50:34.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54092024-09-05T00:50:34.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54102024-09-05T00:50:34.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54112024-09-05T00:50:34.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54122024-09-05T00:50:34.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54132024-09-05T00:50:34.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54142024-09-05T00:50:34.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54152024-09-05T00:50:34.972ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54162024-09-05T00:50:34.972ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54172024-09-05T00:50:34.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54182024-09-05T00:50:34.975ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54192024-09-05T00:50:34.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54202024-09-05T00:50:34.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54212024-09-05T00:50:34.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54222024-09-05T00:50:34.975ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54232024-09-05T00:50:34.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54242024-09-05T00:50:34.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
54252024-09-05T00:50:34.976ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54262024-09-05T00:50:34.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54272024-09-05T00:50:34.977ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54282024-09-05T00:50:34.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54292024-09-05T00:50:34.980ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.921355ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
54302024-09-05T00:50:34.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54312024-09-05T00:50:34.981ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54322024-09-05T00:50:34.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54332024-09-05T00:50:34.983ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54342024-09-05T00:50:34.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54352024-09-05T00:50:34.984ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3897, tv_nsec: 48679081 } })
54362024-09-05T00:50:34.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54372024-09-05T00:50:34.984ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54382024-09-05T00:50:34.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54392024-09-05T00:50:34.985ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
54402024-09-05T00:50:34.985ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54412024-09-05T00:50:34.986ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54422024-09-05T00:50:34.986ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54432024-09-05T00:50:34.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54442024-09-05T00:50:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
54452024-09-05T00:50:34.989ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54462024-09-05T00:50:34.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54472024-09-05T00:50:35.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54482024-09-05T00:50:35.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54492024-09-05T00:50:35.018ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
54502024-09-05T00:50:35.018ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54512024-09-05T00:50:35.018ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54522024-09-05T00:50:35.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54532024-09-05T00:50:35.022ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54542024-09-05T00:50:35.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54552024-09-05T00:50:35.023ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
54562024-09-05T00:50:35.023ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
54572024-09-05T00:50:35.023ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.29116ms iteration = 9 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
54582024-09-05T00:50:35.024ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54592024-09-05T00:50:35.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54602024-09-05T00:50:35.025ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54612024-09-05T00:50:35.026ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
54622024-09-05T00:50:35.026ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
54632024-09-05T00:50:35.026ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
54642024-09-05T00:50:35.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54652024-09-05T00:50:35.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54662024-09-05T00:50:35.028ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54672024-09-05T00:50:35.028ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
54682024-09-05T00:50:35.028ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
54692024-09-05T00:50:35.028ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 71.808658ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
54702024-09-05T00:50:35.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54712024-09-05T00:50:35.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54722024-09-05T00:50:35.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54732024-09-05T00:50:35.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54742024-09-05T00:50:35.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54752024-09-05T00:50:35.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54762024-09-05T00:50:35.029ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
54772024-09-05T00:50:35.029ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
54782024-09-05T00:50:35.029ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
54792024-09-05T00:50:35.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54802024-09-05T00:50:35.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54812024-09-05T00:50:35.032ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54822024-09-05T00:50:35.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54832024-09-05T00:50:35.033ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.369779ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
54842024-09-05T00:50:35.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54852024-09-05T00:50:35.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
54862024-09-05T00:50:35.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54872024-09-05T00:50:35.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54882024-09-05T00:50:35.063ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54892024-09-05T00:50:35.063ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.859213ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54902024-09-05T00:50:35.137ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
54912024-09-05T00:50:35.137ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54922024-09-05T00:50:35.137ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d332e67b-3ca2-4036-8947-ce3f42c7dbce", "content-length": "26", "date": "Thu, 05 Sep 2024 00:50:34 GMT"} })
54932024-09-05T00:50:35.137ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54942024-09-05T00:50:35.139ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54952024-09-05T00:50:35.256ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
54962024-09-05T00:50:35.268ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1310 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = eaeabde5-4a14-4858-bbd0-cbc2060794ff response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
54972024-09-05T00:50:35.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b5e4ad8b-6eea-4490-9a12-b6b022c6c3d2 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
54982024-09-05T00:50:35.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b5e4ad8b-6eea-4490-9a12-b6b022c6c3d2 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
54992024-09-05T00:50:35.324ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
55002024-09-05T00:50:35.329ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
55012024-09-05T00:50:35.329ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55022024-09-05T00:50:35.330ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "703476b7-0662-4c25-bae9-d6f022a7349a", "content-length": "26", "date": "Thu, 05 Sep 2024 00:50:34 GMT"} })
55032024-09-05T00:50:35.330ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55042024-09-05T00:50:35.331ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55052024-09-05T00:50:35.399ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b zone_address = fd00:1122:3344:101::2
55062024-09-05T00:50:35.399ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55072024-09-05T00:50:35.399ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "19559fcb-843d-4340-b588-280d1b14150b", "content-length": "26", "date": "Thu, 05 Sep 2024 00:50:34 GMT"} })
55082024-09-05T00:50:35.399ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55092024-09-05T00:50:35.401ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
55102024-09-05T00:50:35.405ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55112024-09-05T00:50:35.405ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fdff0199-e8f3-4d4f-9901-059baf7c88c0", "content-length": "372", "date": "Thu, 05 Sep 2024 00:50:34 GMT"} })
55122024-09-05T00:50:35.405ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55132024-09-05T00:50:35.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55142024-09-05T00:50:35.408ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55152024-09-05T00:50:35.410ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55162024-09-05T00:50:35.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55172024-09-05T00:50:35.410ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55182024-09-05T00:50:35.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55192024-09-05T00:50:35.412ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55202024-09-05T00:50:35.412ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55212024-09-05T00:50:35.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55222024-09-05T00:50:35.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 136824 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b5e4ad8b-6eea-4490-9a12-b6b022c6c3d2 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
55232024-09-05T00:50:35.416ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55242024-09-05T00:50:35.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55252024-09-05T00:50:35.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55262024-09-05T00:50:35.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55272024-09-05T00:50:35.424ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
55282024-09-05T00:50:35.424ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 467.983341ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
55292024-09-05T00:50:35.429ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55302024-09-05T00:50:35.429ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e475cc88-bb73-459e-a28a-07b18d7bf140", "date": "Thu, 05 Sep 2024 00:50:34 GMT"} })
55312024-09-05T00:50:35.434ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 477.764716ms iteration = 19 status = {}
55322024-09-05T00:50:35.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 480.31336ms iteration = 17 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
55332024-09-05T00:50:35.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55342024-09-05T00:50:35.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55352024-09-05T00:50:35.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 484.76944ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55362024-09-05T00:50:35.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55372024-09-05T00:50:35.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55382024-09-05T00:50:35.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55392024-09-05T00:50:35.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55402024-09-05T00:50:35.444ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55412024-09-05T00:50:35.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55422024-09-05T00:50:35.446ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 485.32293ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
55432024-09-05T00:50:35.447ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
55442024-09-05T00:50:35.447ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55452024-09-05T00:50:35.447ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 490.500352ms iteration = 17 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
55462024-09-05T00:50:35.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55472024-09-05T00:50:35.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a014d257-275c-449e-a4f4-aef00eab141c, lookup_type: ById(a014d257-275c-449e-a4f4-aef00eab141c) } result = Ok(())
55482024-09-05T00:50:35.450ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55492024-09-05T00:50:35.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55502024-09-05T00:50:35.450ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
55512024-09-05T00:50:35.450ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 32541e10-8a85-4410-9858-67a9ab52251d dns_zone_name = oxide.test found_so_far = 0 version = 2
55522024-09-05T00:50:35.450ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55532024-09-05T00:50:35.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55542024-09-05T00:50:35.453ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 495.558692ms iteration = 17 status = 0
55552024-09-05T00:50:35.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55562024-09-05T00:50:35.456ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55572024-09-05T00:50:35.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55582024-09-05T00:50:35.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55592024-09-05T00:50:35.456ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55602024-09-05T00:50:35.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55612024-09-05T00:50:35.457ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55622024-09-05T00:50:35.459ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55632024-09-05T00:50:35.459ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55642024-09-05T00:50:35.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55652024-09-05T00:50:35.465ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 508.526503ms iteration = 20 status = {"physical_disks_added":0}
55662024-09-05T00:50:35.471ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
55672024-09-05T00:50:35.471ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 510.333816ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
55682024-09-05T00:50:35.472ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
55692024-09-05T00:50:35.472ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 59a6be26-b8fa-4e7a-8244-7a4e92426c26 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
55702024-09-05T00:50:35.472ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55712024-09-05T00:50:35.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55722024-09-05T00:50:35.473ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55732024-09-05T00:50:35.475ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
55742024-09-05T00:50:35.475ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55752024-09-05T00:50:35.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55762024-09-05T00:50:35.479ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55772024-09-05T00:50:35.482ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55782024-09-05T00:50:35.482ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55792024-09-05T00:50:35.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55802024-09-05T00:50:35.483ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 32541e10-8a85-4410-9858-67a9ab52251d dns_zone_name = oxide.test found_so_far = 1 version = 2
55812024-09-05T00:50:35.483ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
55822024-09-05T00:50:35.483ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-05 00:42:43.837540 UTC dns_group = external generation = 2
55832024-09-05T00:50:35.483ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 528.158092ms iteration = 10 status = {"generation":2}
55842024-09-05T00:50:35.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55852024-09-05T00:50:35.490ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55862024-09-05T00:50:35.490ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55872024-09-05T00:50:35.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55882024-09-05T00:50:35.498ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 542.475148ms iteration = 17 status = {}
55892024-09-05T00:50:35.501ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55902024-09-05T00:50:35.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55912024-09-05T00:50:35.503ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55922024-09-05T00:50:35.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55932024-09-05T00:50:35.506ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 59a6be26-b8fa-4e7a-8244-7a4e92426c26 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
55942024-09-05T00:50:35.506ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
55952024-09-05T00:50:35.506ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-05 00:42:43.011780 UTC dns_group = internal generation = 1
55962024-09-05T00:50:35.506ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 550.669474ms iteration = 10 status = {"generation":1}
55972024-09-05T00:50:35.509ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-05T00:42:33.143008Z, time_modified: 2024-09-05T00:42:33.143008Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2d4fccaa-0031-45b8-a053-9531608bab06, db_silo: Silo { identity: SiloIdentity { id: 2d4fccaa-0031-45b8-a053-9531608bab06, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-05T00:42:43.791199Z, time_modified: 2024-09-05T00:42:43.791199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2d4fccaa-0031-45b8-a053-9531608bab06, db_silo: Silo { identity: SiloIdentity { id: 2d4fccaa-0031-45b8-a053-9531608bab06, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-05T00:42:43.791199Z, time_modified: 2024-09-05T00:42:43.791199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017" }] }) }
55982024-09-05T00:50:35.509ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 553.87614ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2d4fccaa-0031-45b8-a053-9531608bab06","tls_certs":["a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017"]}},"default_endpoint":{"silo_id":"2d4fccaa-0031-45b8-a053-9531608bab06","tls_certs":["a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
55992024-09-05T00:50:35.511ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
56002024-09-05T00:50:35.512ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4ee3dbe4-6f46-4063-9183-4ca0fc851088", "content-length": "2", "date": "Thu, 05 Sep 2024 00:50:34 GMT"} })
56012024-09-05T00:50:35.513ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56022024-09-05T00:50:35.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56032024-09-05T00:50:35.515ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 560.012759ms iteration = 17 status = null
56042024-09-05T00:50:35.524ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
56052024-09-05T00:50:35.524ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bb8797d8-4c28-45b4-855b-d15d1efa32f4", "date": "Thu, 05 Sep 2024 00:50:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56062024-09-05T00:50:35.524ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56072024-09-05T00:50:35.525ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "316885e7-6703-415b-9fdd-4d2db108e009", "date": "Thu, 05 Sep 2024 00:50:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56082024-09-05T00:50:35.525ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56092024-09-05T00:50:35.525ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
56102024-09-05T00:50:35.527ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
56112024-09-05T00:50:35.527ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 572.025394ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
56122024-09-05T00:50:35.607ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
56132024-09-05T00:50:35.608ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5d4fb4c1-076b-49e4-99b4-b6398b575305", "date": "Thu, 05 Sep 2024 00:50:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56142024-09-05T00:50:35.608ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56152024-09-05T00:50:35.609ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "def9d34e-7839-479a-b33e-6906d5e2edbf", "date": "Thu, 05 Sep 2024 00:50:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56162024-09-05T00:50:35.609ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56172024-09-05T00:50:35.611ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4d65203c-f7c1-4cef-9ce5-688b17c31025", "date": "Thu, 05 Sep 2024 00:50:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56182024-09-05T00:50:35.611ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56192024-09-05T00:50:35.613ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
56202024-09-05T00:50:35.613ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 657.856942ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
56212024-09-05T00:50:35.622ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56222024-09-05T00:50:35.623ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "74486ce4-8b4d-4560-98d2-309728758081", "content-length": "691", "date": "Thu, 05 Sep 2024 00:50:34 GMT"} })
56232024-09-05T00:50:35.623ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
56242024-09-05T00:50:35.623ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
56252024-09-05T00:50:35.623ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
56262024-09-05T00:50:35.624ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 667.901351ms iteration = 18 status = {}
56272024-09-05T00:50:35.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56282024-09-05T00:50:35.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56292024-09-05T00:50:35.650ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 3013d0b1-47fb-4df1-97e5-7049d1043033, rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c4762fe-488f-4054-979a-f54d371ea654) } rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
56302024-09-05T00:50:35.650ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56312024-09-05T00:50:35.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56322024-09-05T00:50:35.660ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56332024-09-05T00:50:35.660ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2634cf09-b35e-4cf2-8348-955fc9fee57f", "content-length": "121", "date": "Thu, 05 Sep 2024 00:50:34 GMT"} })
56342024-09-05T00:50:35.660ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
56352024-09-05T00:50:35.660ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c4762fe-488f-4054-979a-f54d371ea654
56362024-09-05T00:50:35.661ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56372024-09-05T00:50:35.661ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56382024-09-05T00:50:35.661ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
56392024-09-05T00:50:35.661ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
56402024-09-05T00:50:35.661ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
56412024-09-05T00:50:35.661ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56422024-09-05T00:50:35.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56432024-09-05T00:50:35.662ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56442024-09-05T00:50:35.662ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "204d32aa-42c4-4b4d-8639-96db0dcca8a2", "content-length": "2", "date": "Thu, 05 Sep 2024 00:50:34 GMT"} })
56452024-09-05T00:50:35.662ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56462024-09-05T00:50:35.662ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b0bf8eed-8d2b-457e-aded-458c667e9691", "content-length": "51", "date": "Thu, 05 Sep 2024 00:50:34 GMT"} })
56472024-09-05T00:50:35.662ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
56482024-09-05T00:50:35.662ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56492024-09-05T00:50:35.755ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "995c9772-e91c-40a9-8b5a-592a7179dcca", "date": "Thu, 05 Sep 2024 00:50:34 GMT"} })
56502024-09-05T00:50:35.755ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch = Switch0
56512024-09-05T00:50:35.755ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56522024-09-05T00:50:35.755ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2e1fbb5f-1810-4560-93c7-83cc4769a2ff", "content-length": "667", "date": "Thu, 05 Sep 2024 00:50:34 GMT"} })
56532024-09-05T00:50:35.755ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56542024-09-05T00:50:35.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56552024-09-05T00:50:35.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56562024-09-05T00:50:35.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56572024-09-05T00:50:35.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56582024-09-05T00:50:35.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56592024-09-05T00:50:35.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56602024-09-05T00:50:35.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56612024-09-05T00:50:35.773ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 817.105357ms iteration = 17 status = {}
56622024-09-05T00:50:36.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6d4c670d-8e57-4bc3-9839-752de6323373 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56632024-09-05T00:50:36.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6d4c670d-8e57-4bc3-9839-752de6323373 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56642024-09-05T00:50:36.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6d4c670d-8e57-4bc3-9839-752de6323373 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56652024-09-05T00:50:37.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 44028be7-4999-47ff-ae75-5f30d9806e0a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56662024-09-05T00:50:37.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 44028be7-4999-47ff-ae75-5f30d9806e0a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56672024-09-05T00:50:37.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2343 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 44028be7-4999-47ff-ae75-5f30d9806e0a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56682024-09-05T00:50:38.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5163c772-009e-41e1-ad96-a79f27113e6f roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56692024-09-05T00:50:38.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5163c772-009e-41e1-ad96-a79f27113e6f resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56702024-09-05T00:50:38.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2456 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5163c772-009e-41e1-ad96-a79f27113e6f response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56712024-09-05T00:50:39.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5c794385-f522-46b7-9d1a-50bc30ebb867 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56722024-09-05T00:50:39.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5c794385-f522-46b7-9d1a-50bc30ebb867 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56732024-09-05T00:50:39.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5c794385-f522-46b7-9d1a-50bc30ebb867 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56742024-09-05T00:50:40.493ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:37969
56752024-09-05T00:50:40.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37969 req_id = 0b66da0e-4366-4ae6-90f3-d9172511bc3f roles = RoleSet { roles: {} } uri = /metrics/producers
56762024-09-05T00:50:40.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37969 req_id = 0b66da0e-4366-4ae6-90f3-d9172511bc3f resource = Database result = Ok(()) uri = /metrics/producers
56772024-09-05T00:50:40.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 198ae003-0c60-4e22-a36b-9ecedf4d889f roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56782024-09-05T00:50:40.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 198ae003-0c60-4e22-a36b-9ecedf4d889f resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56792024-09-05T00:50:40.526ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
56802024-09-05T00:50:40.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37969 req_id = 0b66da0e-4366-4ae6-90f3-d9172511bc3f roles = RoleSet { roles: {} } uri = /metrics/producers
56812024-09-05T00:50:40.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37969 req_id = 0b66da0e-4366-4ae6-90f3-d9172511bc3f resource = Database result = Ok(()) uri = /metrics/producers
56822024-09-05T00:50:40.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 198ae003-0c60-4e22-a36b-9ecedf4d889f response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56832024-09-05T00:50:40.560ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
56842024-09-05T00:50:40.561ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3a092247-f413-4dba-8386-331cdd1af744", "date": "Thu, 05 Sep 2024 00:50:40 GMT"} })
56852024-09-05T00:50:40.561ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = a014d257-275c-449e-a4f4-aef00eab141c
56862024-09-05T00:50:40.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 68578 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37969 req_id = 0b66da0e-4366-4ae6-90f3-d9172511bc3f response_code = 201 uri = /metrics/producers
56872024-09-05T00:50:41.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 01441379-e998-4873-9629-af4e316c2c32 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56882024-09-05T00:50:41.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 01441379-e998-4873-9629-af4e316c2c32 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56892024-09-05T00:50:41.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 01441379-e998-4873-9629-af4e316c2c32 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
56902024-09-05T00:50:41.799ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:47727
56912024-09-05T00:50:41.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47727 req_id = 2d724324-137e-4976-81f4-96a832ba50f6 roles = RoleSet { roles: {} } uri = /metrics/producers
56922024-09-05T00:50:41.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47727 req_id = 2d724324-137e-4976-81f4-96a832ba50f6 resource = Database result = Ok(()) uri = /metrics/producers
56932024-09-05T00:50:41.834ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 19d1dcd9-c605-423b-803d-56a986947027
56942024-09-05T00:50:41.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47727 req_id = 2d724324-137e-4976-81f4-96a832ba50f6 roles = RoleSet { roles: {} } uri = /metrics/producers
56952024-09-05T00:50:41.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47727 req_id = 2d724324-137e-4976-81f4-96a832ba50f6 resource = Database result = Ok(()) uri = /metrics/producers
56962024-09-05T00:50:41.865ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 uri = http://[fd00:1122:3344:101::d]:12223/producers
56972024-09-05T00:50:41.865ZDEBGnexus: client response oximeter-collector = 19d1dcd9-c605-423b-803d-56a986947027 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9d61c4ee-039f-4398-982d-3e52fede6927", "date": "Thu, 05 Sep 2024 00:50:41 GMT"} })
56982024-09-05T00:50:41.865ZINFOnexus: assigned collector to new producer collector_id = 19d1dcd9-c605-423b-803d-56a986947027 file = nexus/src/app/oximeter.rs:125 producer_id = 7133bf3b-5b99-4a6e-bebd-7577dd2d3d94
56992024-09-05T00:50:41.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 68063 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47727 req_id = 2d724324-137e-4976-81f4-96a832ba50f6 response_code = 201 uri = /metrics/producers
57002024-09-05T00:50:42.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0a2ccf18-8614-400b-8a42-a7ce729b009a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57012024-09-05T00:50:42.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0a2ccf18-8614-400b-8a42-a7ce729b009a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57022024-09-05T00:50:42.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0a2ccf18-8614-400b-8a42-a7ce729b009a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57032024-09-05T00:50:43.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f2d6383f-a286-470c-a1ab-e1b68395c041 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57042024-09-05T00:50:43.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f2d6383f-a286-470c-a1ab-e1b68395c041 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57052024-09-05T00:50:43.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f2d6383f-a286-470c-a1ab-e1b68395c041 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57062024-09-05T00:50:44.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6149813e-b17b-425f-99f7-f37dffff2efb roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57072024-09-05T00:50:44.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6149813e-b17b-425f-99f7-f37dffff2efb resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57082024-09-05T00:50:44.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6149813e-b17b-425f-99f7-f37dffff2efb response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57092024-09-05T00:50:44.957ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
57102024-09-05T00:50:44.957ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
57112024-09-05T00:50:44.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57122024-09-05T00:50:44.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57132024-09-05T00:50:44.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57142024-09-05T00:50:44.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57152024-09-05T00:50:44.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57162024-09-05T00:50:44.960ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57172024-09-05T00:50:44.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57182024-09-05T00:50:44.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57192024-09-05T00:50:44.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57202024-09-05T00:50:44.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57212024-09-05T00:50:44.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57222024-09-05T00:50:44.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57232024-09-05T00:50:44.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57242024-09-05T00:50:44.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
57252024-09-05T00:50:44.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57262024-09-05T00:50:44.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57272024-09-05T00:50:44.977ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
57282024-09-05T00:50:44.977ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.373474ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
57292024-09-05T00:50:44.985ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.08265ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57302024-09-05T00:50:45.268ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1576 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 9d90ba34-1f8c-4a57-a9eb-1d24fbfbe536 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
57312024-09-05T00:50:45.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 20dcb1fd-a84c-436f-b9a1-2381a52bb79d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57322024-09-05T00:50:45.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 20dcb1fd-a84c-436f-b9a1-2381a52bb79d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57332024-09-05T00:50:45.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 20dcb1fd-a84c-436f-b9a1-2381a52bb79d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57342024-09-05T00:50:46.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bab88a1f-9db6-4e05-a804-487baf587ad5 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57352024-09-05T00:50:46.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bab88a1f-9db6-4e05-a804-487baf587ad5 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57362024-09-05T00:50:46.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bab88a1f-9db6-4e05-a804-487baf587ad5 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57372024-09-05T00:50:47.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3b76e9ba-cb07-4788-ba88-f69697300bcf roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57382024-09-05T00:50:47.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3b76e9ba-cb07-4788-ba88-f69697300bcf resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57392024-09-05T00:50:47.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 3b76e9ba-cb07-4788-ba88-f69697300bcf response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57402024-09-05T00:50:48.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 44903623-de8f-4d6a-86d0-c68c6e6f3869 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57412024-09-05T00:50:48.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 44903623-de8f-4d6a-86d0-c68c6e6f3869 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57422024-09-05T00:50:48.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 44903623-de8f-4d6a-86d0-c68c6e6f3869 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57432024-09-05T00:50:49.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 300fbf84-0abe-409b-b231-72c8efc56565 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57442024-09-05T00:50:49.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 300fbf84-0abe-409b-b231-72c8efc56565 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57452024-09-05T00:50:49.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 300fbf84-0abe-409b-b231-72c8efc56565 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57462024-09-05T00:50:50.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4872c9d1-4d9e-470f-9cbc-32ae4031377e roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57472024-09-05T00:50:50.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4872c9d1-4d9e-470f-9cbc-32ae4031377e resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57482024-09-05T00:50:50.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4872c9d1-4d9e-470f-9cbc-32ae4031377e response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57492024-09-05T00:50:51.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c0529f2c-55ae-4dce-bc85-2cb38236e9c4 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57502024-09-05T00:50:51.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c0529f2c-55ae-4dce-bc85-2cb38236e9c4 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57512024-09-05T00:50:51.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c0529f2c-55ae-4dce-bc85-2cb38236e9c4 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57522024-09-05T00:50:52.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 2cad9e84-d32e-4ea4-a137-aff04f4b4b67 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
57532024-09-05T00:50:52.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 2cad9e84-d32e-4ea4-a137-aff04f4b4b67 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
57542024-09-05T00:50:52.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3423 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 2cad9e84-d32e-4ea4-a137-aff04f4b4b67 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
57552024-09-05T00:50:52.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0e76e698-2108-42e4-b1d3-dacd77f5b118 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57562024-09-05T00:50:52.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0e76e698-2108-42e4-b1d3-dacd77f5b118 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57572024-09-05T00:50:52.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2495 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0e76e698-2108-42e4-b1d3-dacd77f5b118 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57582024-09-05T00:50:53.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = acbb84f1-5c8e-4480-a33a-4ab8a221f30c roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57592024-09-05T00:50:53.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = acbb84f1-5c8e-4480-a33a-4ab8a221f30c resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57602024-09-05T00:50:53.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = acbb84f1-5c8e-4480-a33a-4ab8a221f30c response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57612024-09-05T00:50:54.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 25b437e5-b3f9-4818-853d-9487670c1638 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57622024-09-05T00:50:54.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 25b437e5-b3f9-4818-853d-9487670c1638 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57632024-09-05T00:50:54.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2661 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 25b437e5-b3f9-4818-853d-9487670c1638 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57642024-09-05T00:50:54.957ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
57652024-09-05T00:50:54.957ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
57662024-09-05T00:50:54.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57672024-09-05T00:50:54.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57682024-09-05T00:50:54.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57692024-09-05T00:50:54.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57702024-09-05T00:50:54.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57712024-09-05T00:50:54.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57722024-09-05T00:50:54.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57732024-09-05T00:50:54.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57742024-09-05T00:50:54.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57752024-09-05T00:50:54.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57762024-09-05T00:50:54.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57772024-09-05T00:50:54.968ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
57782024-09-05T00:50:54.968ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57792024-09-05T00:50:54.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57802024-09-05T00:50:54.973ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
57812024-09-05T00:50:54.973ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.956662ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
57822024-09-05T00:50:54.984ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57832024-09-05T00:50:54.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57842024-09-05T00:50:54.986ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.030387ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57852024-09-05T00:50:55.267ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1254 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 3ad7734a-d069-4056-b61f-5dfb98eb8069 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
57862024-09-05T00:50:55.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b1a57fcb-477e-4cef-b5fd-4ecfa7906c04 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57872024-09-05T00:50:55.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b1a57fcb-477e-4cef-b5fd-4ecfa7906c04 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57882024-09-05T00:50:55.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1634 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b1a57fcb-477e-4cef-b5fd-4ecfa7906c04 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57892024-09-05T00:50:56.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 060a0dab-0bea-40f3-b9ae-c16a2cf52e9d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57902024-09-05T00:50:56.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 060a0dab-0bea-40f3-b9ae-c16a2cf52e9d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57912024-09-05T00:50:56.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 060a0dab-0bea-40f3-b9ae-c16a2cf52e9d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57922024-09-05T00:50:57.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ee411eee-e0c3-43af-81e6-b30be67b8f5b roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57932024-09-05T00:50:57.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ee411eee-e0c3-43af-81e6-b30be67b8f5b resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57942024-09-05T00:50:57.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2741 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = ee411eee-e0c3-43af-81e6-b30be67b8f5b response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57952024-09-05T00:50:58.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5f4a46f7-47a2-4cda-bd3a-b275d7921732 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57962024-09-05T00:50:58.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5f4a46f7-47a2-4cda-bd3a-b275d7921732 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57972024-09-05T00:50:58.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5f4a46f7-47a2-4cda-bd3a-b275d7921732 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57982024-09-05T00:50:59.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4ae4cccf-7d4a-481d-a3e1-c5f3aeabfbb7 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
57992024-09-05T00:50:59.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4ae4cccf-7d4a-481d-a3e1-c5f3aeabfbb7 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
58002024-09-05T00:50:59.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4ae4cccf-7d4a-481d-a3e1-c5f3aeabfbb7 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
58012024-09-05T00:51:00.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b33cdcbb-ce41-46ac-aeba-dec43bdadbab roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
58022024-09-05T00:51:00.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b33cdcbb-ce41-46ac-aeba-dec43bdadbab resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
58032024-09-05T00:51:00.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b33cdcbb-ce41-46ac-aeba-dec43bdadbab response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
58042024-09-05T00:51:01.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5990fc2d-45b7-454d-9248-fafe0d99eac7 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
58052024-09-05T00:51:01.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5990fc2d-45b7-454d-9248-fafe0d99eac7 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
58062024-09-05T00:51:01.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5990fc2d-45b7-454d-9248-fafe0d99eac7 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
58072024-09-05T00:51:02.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5726d15c-a031-4aa4-8a63-4809e4b1dbc8 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
58082024-09-05T00:51:02.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5726d15c-a031-4aa4-8a63-4809e4b1dbc8 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
58092024-09-05T00:51:03.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5726d15c-a031-4aa4-8a63-4809e4b1dbc8 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
58102024-09-05T00:51:04.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fecb002d-c96e-4a6d-afd9-8487e7a6aced roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
58112024-09-05T00:51:04.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fecb002d-c96e-4a6d-afd9-8487e7a6aced resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
58122024-09-05T00:51:04.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fecb002d-c96e-4a6d-afd9-8487e7a6aced response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
58132024-09-05T00:51:04.955ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
58142024-09-05T00:51:04.955ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58152024-09-05T00:51:04.955ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
58162024-09-05T00:51:04.955ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58172024-09-05T00:51:04.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58182024-09-05T00:51:04.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58192024-09-05T00:51:04.956ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
58202024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
58212024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
58222024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58232024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58242024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
58252024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58262024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
58272024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
58282024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58292024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58302024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
58312024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58322024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
58332024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58342024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
58352024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58362024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58372024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
58382024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58392024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
58402024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58412024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58422024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58432024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58442024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58452024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58462024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58472024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58482024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58492024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58502024-09-05T00:51:04.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58512024-09-05T00:51:04.958ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3927, tv_nsec: 22408800 } })
58522024-09-05T00:51:04.958ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
58532024-09-05T00:51:04.959ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3927, tv_nsec: 23486049 } })
58542024-09-05T00:51:04.959ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
58552024-09-05T00:51:04.960ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58562024-09-05T00:51:04.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58572024-09-05T00:51:04.960ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58582024-09-05T00:51:04.960ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.285836ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58592024-09-05T00:51:04.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58602024-09-05T00:51:04.961ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
58612024-09-05T00:51:04.961ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58622024-09-05T00:51:04.961ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
58632024-09-05T00:51:04.961ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
58642024-09-05T00:51:04.961ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58652024-09-05T00:51:04.961ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
58662024-09-05T00:51:04.961ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58672024-09-05T00:51:04.961ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58682024-09-05T00:51:04.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58692024-09-05T00:51:04.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58702024-09-05T00:51:04.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58712024-09-05T00:51:04.962ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58722024-09-05T00:51:04.962ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58732024-09-05T00:51:04.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58742024-09-05T00:51:04.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58752024-09-05T00:51:04.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58762024-09-05T00:51:04.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58772024-09-05T00:51:04.963ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58782024-09-05T00:51:04.963ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58792024-09-05T00:51:04.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58802024-09-05T00:51:04.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58812024-09-05T00:51:04.964ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58822024-09-05T00:51:04.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58832024-09-05T00:51:04.965ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 8.036743ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58842024-09-05T00:51:04.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58852024-09-05T00:51:04.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58862024-09-05T00:51:04.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58872024-09-05T00:51:04.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58882024-09-05T00:51:04.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58892024-09-05T00:51:04.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58902024-09-05T00:51:04.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58912024-09-05T00:51:04.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58922024-09-05T00:51:04.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58932024-09-05T00:51:04.972ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58942024-09-05T00:51:04.972ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58952024-09-05T00:51:04.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58962024-09-05T00:51:04.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58972024-09-05T00:51:04.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58982024-09-05T00:51:04.973ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58992024-09-05T00:51:04.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59002024-09-05T00:51:04.974ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3927, tv_nsec: 38740611 } })
59012024-09-05T00:51:04.974ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59022024-09-05T00:51:04.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59032024-09-05T00:51:04.974ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59042024-09-05T00:51:04.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59052024-09-05T00:51:04.976ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
59062024-09-05T00:51:04.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59072024-09-05T00:51:04.976ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59082024-09-05T00:51:04.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59092024-09-05T00:51:04.977ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59102024-09-05T00:51:04.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59112024-09-05T00:51:04.989ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
59122024-09-05T00:51:04.990ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
59132024-09-05T00:51:04.990ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59142024-09-05T00:51:04.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59152024-09-05T00:51:04.992ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59162024-09-05T00:51:04.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59172024-09-05T00:51:04.998ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59182024-09-05T00:51:04.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59192024-09-05T00:51:05.000ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59202024-09-05T00:51:05.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59212024-09-05T00:51:05.001ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59222024-09-05T00:51:05.001ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59232024-09-05T00:51:05.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59242024-09-05T00:51:05.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59252024-09-05T00:51:05.003ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59262024-09-05T00:51:05.003ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 46.501828ms iteration = 18 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
59272024-09-05T00:51:05.004ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59282024-09-05T00:51:05.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a014d257-275c-449e-a4f4-aef00eab141c, lookup_type: ById(a014d257-275c-449e-a4f4-aef00eab141c) } result = Ok(())
59292024-09-05T00:51:05.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59302024-09-05T00:51:05.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59312024-09-05T00:51:05.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
59322024-09-05T00:51:05.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59332024-09-05T00:51:05.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59342024-09-05T00:51:05.008ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 51.174421ms iteration = 18 status = 0
59352024-09-05T00:51:05.009ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 47.351863ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
59362024-09-05T00:51:05.016ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
59372024-09-05T00:51:05.016ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.740026ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
59382024-09-05T00:51:05.025ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
59392024-09-05T00:51:05.025ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
59402024-09-05T00:51:05.025ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 68.374378ms iteration = 18 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
59412024-09-05T00:51:05.029ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59422024-09-05T00:51:05.029ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 68.223875ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
59432024-09-05T00:51:05.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59442024-09-05T00:51:05.036ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
59452024-09-05T00:51:05.036ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59462024-09-05T00:51:05.036ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "86a0778a-1160-47f8-b647-4014e9ad03ce", "content-length": "26", "date": "Thu, 05 Sep 2024 00:51:04 GMT"} })
59472024-09-05T00:51:05.036ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59482024-09-05T00:51:05.038ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59492024-09-05T00:51:05.046ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59502024-09-05T00:51:05.046ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.433722ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59512024-09-05T00:51:05.059ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
59522024-09-05T00:51:05.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 97.447604ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
59532024-09-05T00:51:05.067ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 110.199542ms iteration = 21 status = {"physical_disks_added":0}
59542024-09-05T00:51:05.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59552024-09-05T00:51:05.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59562024-09-05T00:51:05.075ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59572024-09-05T00:51:05.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59582024-09-05T00:51:05.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59592024-09-05T00:51:05.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59602024-09-05T00:51:05.085ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
59612024-09-05T00:51:05.085ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59622024-09-05T00:51:05.085ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b4d5cbb3-722b-45ae-9867-9ffb18ff9eff", "content-length": "26", "date": "Thu, 05 Sep 2024 00:51:04 GMT"} })
59632024-09-05T00:51:05.085ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59642024-09-05T00:51:05.087ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59652024-09-05T00:51:05.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 462435e0-45b7-4e2f-9eec-72fdbbfcc3ef roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
59662024-09-05T00:51:05.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 462435e0-45b7-4e2f-9eec-72fdbbfcc3ef resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
59672024-09-05T00:51:05.151ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
59682024-09-05T00:51:05.151ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "237c311c-e2ec-4117-b48c-f2bf980009fc", "content-length": "2", "date": "Thu, 05 Sep 2024 00:51:04 GMT"} })
59692024-09-05T00:51:05.152ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b zone_address = fd00:1122:3344:101::2
59702024-09-05T00:51:05.152ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59712024-09-05T00:51:05.152ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "951e9862-9ac2-4f7b-a225-b96e2063e033", "content-length": "26", "date": "Thu, 05 Sep 2024 00:51:04 GMT"} })
59722024-09-05T00:51:05.152ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59732024-09-05T00:51:05.154ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59742024-09-05T00:51:05.154ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
59752024-09-05T00:51:05.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59762024-09-05T00:51:05.224ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59772024-09-05T00:51:05.226ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c55e0ea0-7df1-454f-ab7d-359681f8c9d0", "content-length": "372", "date": "Thu, 05 Sep 2024 00:51:04 GMT"} })
59782024-09-05T00:51:05.226ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59792024-09-05T00:51:05.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59802024-09-05T00:51:05.226ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59812024-09-05T00:51:05.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 113543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 462435e0-45b7-4e2f-9eec-72fdbbfcc3ef response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
59822024-09-05T00:51:05.228ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 272.612743ms iteration = 18 status = null
59832024-09-05T00:51:05.228ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59842024-09-05T00:51:05.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59852024-09-05T00:51:05.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59862024-09-05T00:51:05.228ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59872024-09-05T00:51:05.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59882024-09-05T00:51:05.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59892024-09-05T00:51:05.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59902024-09-05T00:51:05.234ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59912024-09-05T00:51:05.235ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b11cf8af-ac3f-4954-8fd2-ffc1e738516d", "date": "Thu, 05 Sep 2024 00:51:04 GMT"} })
59922024-09-05T00:51:05.236ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 279.008477ms iteration = 20 status = {}
59932024-09-05T00:51:05.248ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 293.386604ms iteration = 18 status = {}
59942024-09-05T00:51:05.269ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = a8bafdf9-1dcb-4b8f-8593-5bbc0cb18049 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
59952024-09-05T00:51:05.314ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59962024-09-05T00:51:05.315ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cc6d8b19-bbee-4ae1-8eb5-500c77f38c6a", "content-length": "691", "date": "Thu, 05 Sep 2024 00:51:04 GMT"} })
59972024-09-05T00:51:05.315ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
59982024-09-05T00:51:05.315ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
59992024-09-05T00:51:05.315ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
60002024-09-05T00:51:05.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60012024-09-05T00:51:05.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60022024-09-05T00:51:05.316ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 358.856429ms iteration = 19 status = {}
60032024-09-05T00:51:05.317ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 3013d0b1-47fb-4df1-97e5-7049d1043033, rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c4762fe-488f-4054-979a-f54d371ea654) } rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
60042024-09-05T00:51:05.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60052024-09-05T00:51:05.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60062024-09-05T00:51:05.326ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60072024-09-05T00:51:05.327ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6412afdc-e942-4fb3-868d-43573023a652", "content-length": "121", "date": "Thu, 05 Sep 2024 00:51:04 GMT"} })
60082024-09-05T00:51:05.327ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
60092024-09-05T00:51:05.327ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c4762fe-488f-4054-979a-f54d371ea654
60102024-09-05T00:51:05.327ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60112024-09-05T00:51:05.327ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60122024-09-05T00:51:05.327ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
60132024-09-05T00:51:05.327ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
60142024-09-05T00:51:05.327ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
60152024-09-05T00:51:05.327ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60162024-09-05T00:51:05.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60172024-09-05T00:51:05.329ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60182024-09-05T00:51:05.330ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "56495f81-4568-4847-99c5-80de0b195bce", "content-length": "2", "date": "Thu, 05 Sep 2024 00:51:04 GMT"} })
60192024-09-05T00:51:05.330ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60202024-09-05T00:51:05.330ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "86f437eb-abe3-4ab7-a306-0b6b2d1fc388", "content-length": "51", "date": "Thu, 05 Sep 2024 00:51:04 GMT"} })
60212024-09-05T00:51:05.330ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
60222024-09-05T00:51:05.330ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60232024-09-05T00:51:05.424ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d9a50f15-dc1f-4e33-9878-3cddada6df80", "date": "Thu, 05 Sep 2024 00:51:04 GMT"} })
60242024-09-05T00:51:05.424ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch = Switch0
60252024-09-05T00:51:05.424ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60262024-09-05T00:51:05.424ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6c9f1ed3-7531-48a0-8d02-1305f1ec5edb", "content-length": "667", "date": "Thu, 05 Sep 2024 00:51:04 GMT"} })
60272024-09-05T00:51:05.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60282024-09-05T00:51:05.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60292024-09-05T00:51:05.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60302024-09-05T00:51:05.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60312024-09-05T00:51:05.431ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60322024-09-05T00:51:05.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60332024-09-05T00:51:05.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60342024-09-05T00:51:05.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60352024-09-05T00:51:05.439ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 482.302296ms iteration = 18 status = {}
60362024-09-05T00:51:06.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c5a54a7b-b9d5-4aea-b0f8-ca440a0911b1 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60372024-09-05T00:51:06.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c5a54a7b-b9d5-4aea-b0f8-ca440a0911b1 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60382024-09-05T00:51:06.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c5a54a7b-b9d5-4aea-b0f8-ca440a0911b1 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60392024-09-05T00:51:07.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = eeb65077-76eb-4d35-b1f0-3a467819af68 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60402024-09-05T00:51:07.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = eeb65077-76eb-4d35-b1f0-3a467819af68 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60412024-09-05T00:51:07.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = eeb65077-76eb-4d35-b1f0-3a467819af68 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60422024-09-05T00:51:08.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 143b14f3-946e-48dd-9c95-f205c691933a roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60432024-09-05T00:51:08.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 143b14f3-946e-48dd-9c95-f205c691933a resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60442024-09-05T00:51:08.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2723 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 143b14f3-946e-48dd-9c95-f205c691933a response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60452024-09-05T00:51:09.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f205dc5d-263d-4cd0-8291-32a3d77d4722 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60462024-09-05T00:51:09.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f205dc5d-263d-4cd0-8291-32a3d77d4722 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60472024-09-05T00:51:09.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2884 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = f205dc5d-263d-4cd0-8291-32a3d77d4722 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60482024-09-05T00:51:10.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 66bfcb56-b1e1-4fc6-a134-48df764f31e2 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60492024-09-05T00:51:10.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 66bfcb56-b1e1-4fc6-a134-48df764f31e2 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60502024-09-05T00:51:10.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2894 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 66bfcb56-b1e1-4fc6-a134-48df764f31e2 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60512024-09-05T00:51:11.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 29eb01bc-77ce-435e-ad26-172feb7d96c3 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60522024-09-05T00:51:11.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 29eb01bc-77ce-435e-ad26-172feb7d96c3 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60532024-09-05T00:51:11.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2624 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 29eb01bc-77ce-435e-ad26-172feb7d96c3 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60542024-09-05T00:51:12.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bf79f65a-2d43-4425-8f91-ffba67206afd roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60552024-09-05T00:51:12.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bf79f65a-2d43-4425-8f91-ffba67206afd resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60562024-09-05T00:51:12.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bf79f65a-2d43-4425-8f91-ffba67206afd response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60572024-09-05T00:51:13.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1b9bd4b2-7042-415f-acbd-d1d2fc1cb51b roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60582024-09-05T00:51:13.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1b9bd4b2-7042-415f-acbd-d1d2fc1cb51b resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60592024-09-05T00:51:13.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1b9bd4b2-7042-415f-acbd-d1d2fc1cb51b response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60602024-09-05T00:51:14.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bc169e44-1fd1-47fd-b68e-db18b134aa90 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60612024-09-05T00:51:14.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bc169e44-1fd1-47fd-b68e-db18b134aa90 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60622024-09-05T00:51:14.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = bc169e44-1fd1-47fd-b68e-db18b134aa90 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60632024-09-05T00:51:14.958ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
60642024-09-05T00:51:14.958ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
60652024-09-05T00:51:14.958ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60662024-09-05T00:51:14.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60672024-09-05T00:51:14.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60682024-09-05T00:51:14.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60692024-09-05T00:51:14.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60702024-09-05T00:51:14.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60712024-09-05T00:51:14.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60722024-09-05T00:51:14.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60732024-09-05T00:51:14.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60742024-09-05T00:51:14.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60752024-09-05T00:51:14.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60762024-09-05T00:51:14.968ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
60772024-09-05T00:51:14.968ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60782024-09-05T00:51:14.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60792024-09-05T00:51:14.977ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
60802024-09-05T00:51:14.977ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.226862ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
60812024-09-05T00:51:14.985ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60822024-09-05T00:51:14.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60832024-09-05T00:51:15.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.608555ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60842024-09-05T00:51:15.268ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1455 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 28d0ad62-6f42-44dc-93ef-e62fe19c3c8b response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
60852024-09-05T00:51:15.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1d54dfbf-b8e0-4d9d-bde9-b7d791421f92 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60862024-09-05T00:51:15.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1d54dfbf-b8e0-4d9d-bde9-b7d791421f92 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60872024-09-05T00:51:15.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1d54dfbf-b8e0-4d9d-bde9-b7d791421f92 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60882024-09-05T00:51:16.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7d51f226-5b35-4613-9464-6b65b6d85d95 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60892024-09-05T00:51:16.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7d51f226-5b35-4613-9464-6b65b6d85d95 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60902024-09-05T00:51:16.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7d51f226-5b35-4613-9464-6b65b6d85d95 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60912024-09-05T00:51:17.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2e52bf4a-0cc1-4ce2-b59a-ef1703c5bcdf roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60922024-09-05T00:51:17.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2e52bf4a-0cc1-4ce2-b59a-ef1703c5bcdf resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60932024-09-05T00:51:17.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2697 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2e52bf4a-0cc1-4ce2-b59a-ef1703c5bcdf response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60942024-09-05T00:51:18.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a981f9e2-46fb-471a-95fc-121a86627189 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60952024-09-05T00:51:18.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a981f9e2-46fb-471a-95fc-121a86627189 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60962024-09-05T00:51:18.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a981f9e2-46fb-471a-95fc-121a86627189 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60972024-09-05T00:51:19.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 19e0f836-0dfc-4dd9-a9e4-e06c868cc0d2 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60982024-09-05T00:51:19.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 19e0f836-0dfc-4dd9-a9e4-e06c868cc0d2 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
60992024-09-05T00:51:19.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 19e0f836-0dfc-4dd9-a9e4-e06c868cc0d2 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61002024-09-05T00:51:20.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4f57c87d-bc3c-4b4d-bcc7-ae61fbf275b9 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61012024-09-05T00:51:20.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4f57c87d-bc3c-4b4d-bcc7-ae61fbf275b9 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61022024-09-05T00:51:20.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4f57c87d-bc3c-4b4d-bcc7-ae61fbf275b9 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61032024-09-05T00:51:21.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fb1d4d69-8457-4aff-9464-687dca8c6c86 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61042024-09-05T00:51:21.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fb1d4d69-8457-4aff-9464-687dca8c6c86 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61052024-09-05T00:51:21.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fb1d4d69-8457-4aff-9464-687dca8c6c86 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61062024-09-05T00:51:22.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 13e2c836-83de-4a13-bab8-00add0a63702 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
61072024-09-05T00:51:22.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 13e2c836-83de-4a13-bab8-00add0a63702 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
61082024-09-05T00:51:22.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3471 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 13e2c836-83de-4a13-bab8-00add0a63702 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
61092024-09-05T00:51:22.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b862ae22-5daf-47ae-b73d-4128c94314c1 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61102024-09-05T00:51:22.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b862ae22-5daf-47ae-b73d-4128c94314c1 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61112024-09-05T00:51:22.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b862ae22-5daf-47ae-b73d-4128c94314c1 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61122024-09-05T00:51:23.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2e900392-0cc0-4fd4-ae9b-83ee186055dd roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61132024-09-05T00:51:23.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2e900392-0cc0-4fd4-ae9b-83ee186055dd resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61142024-09-05T00:51:23.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2e900392-0cc0-4fd4-ae9b-83ee186055dd response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61152024-09-05T00:51:24.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c66a3c25-6c32-401f-964f-1b10ab8fcfb6 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61162024-09-05T00:51:24.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c66a3c25-6c32-401f-964f-1b10ab8fcfb6 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61172024-09-05T00:51:24.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1771 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c66a3c25-6c32-401f-964f-1b10ab8fcfb6 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61182024-09-05T00:51:24.957ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
61192024-09-05T00:51:24.957ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
61202024-09-05T00:51:24.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61212024-09-05T00:51:24.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61222024-09-05T00:51:24.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61232024-09-05T00:51:24.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61242024-09-05T00:51:24.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61252024-09-05T00:51:24.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61262024-09-05T00:51:24.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61272024-09-05T00:51:24.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61282024-09-05T00:51:24.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61292024-09-05T00:51:24.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61302024-09-05T00:51:24.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61312024-09-05T00:51:24.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
61322024-09-05T00:51:24.967ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61332024-09-05T00:51:24.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61342024-09-05T00:51:24.975ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
61352024-09-05T00:51:24.975ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.144273ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
61362024-09-05T00:51:24.984ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61372024-09-05T00:51:24.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61382024-09-05T00:51:25.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.022953ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61392024-09-05T00:51:25.268ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1417 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 6f326d16-4a98-4922-b13f-d7fdf892ebf3 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
61402024-09-05T00:51:25.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 788cf1f0-3e60-428d-aaf7-0ae520f432d6 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61412024-09-05T00:51:25.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 788cf1f0-3e60-428d-aaf7-0ae520f432d6 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61422024-09-05T00:51:25.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 788cf1f0-3e60-428d-aaf7-0ae520f432d6 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61432024-09-05T00:51:26.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 70a9917b-5a6f-473a-a11c-60a435891a70 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61442024-09-05T00:51:26.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 70a9917b-5a6f-473a-a11c-60a435891a70 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61452024-09-05T00:51:26.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 70a9917b-5a6f-473a-a11c-60a435891a70 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61462024-09-05T00:51:27.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a179a2e0-d99f-40ae-9443-7bfacedfac2f roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61472024-09-05T00:51:27.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a179a2e0-d99f-40ae-9443-7bfacedfac2f resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61482024-09-05T00:51:27.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = a179a2e0-d99f-40ae-9443-7bfacedfac2f response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61492024-09-05T00:51:28.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 89012e21-459f-41c3-87c7-6e27a93caaba roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61502024-09-05T00:51:28.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 89012e21-459f-41c3-87c7-6e27a93caaba resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61512024-09-05T00:51:28.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 89012e21-459f-41c3-87c7-6e27a93caaba response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61522024-09-05T00:51:29.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 51973716-a05f-4c83-a202-e0d6a81c52c5 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61532024-09-05T00:51:29.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 51973716-a05f-4c83-a202-e0d6a81c52c5 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61542024-09-05T00:51:29.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 51973716-a05f-4c83-a202-e0d6a81c52c5 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61552024-09-05T00:51:30.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b82df9a4-f0fb-422f-a874-20e817b5a740 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61562024-09-05T00:51:30.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b82df9a4-f0fb-422f-a874-20e817b5a740 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61572024-09-05T00:51:30.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2602 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b82df9a4-f0fb-422f-a874-20e817b5a740 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61582024-09-05T00:51:31.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 289e86da-422f-408b-82a6-a10b3dd79f30 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61592024-09-05T00:51:31.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 289e86da-422f-408b-82a6-a10b3dd79f30 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61602024-09-05T00:51:31.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 289e86da-422f-408b-82a6-a10b3dd79f30 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61612024-09-05T00:51:32.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4ce90a86-d4be-470d-8148-51ce566000ee roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61622024-09-05T00:51:32.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4ce90a86-d4be-470d-8148-51ce566000ee resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61632024-09-05T00:51:32.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1948 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 4ce90a86-d4be-470d-8148-51ce566000ee response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61642024-09-05T00:51:33.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b1bce28a-6139-4688-b191-1e9dae50dd9d roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61652024-09-05T00:51:33.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b1bce28a-6139-4688-b191-1e9dae50dd9d resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61662024-09-05T00:51:33.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b1bce28a-6139-4688-b191-1e9dae50dd9d response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61672024-09-05T00:51:34.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 72bb089b-153a-4601-a9be-9d825d69101e roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61682024-09-05T00:51:34.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 72bb089b-153a-4601-a9be-9d825d69101e resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61692024-09-05T00:51:34.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 72bb089b-153a-4601-a9be-9d825d69101e response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
61702024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
61712024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
61722024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61732024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
61742024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61752024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
61762024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
61772024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
61782024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61792024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
61802024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
61812024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
61822024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61832024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
61842024-09-05T00:51:34.956ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-05 00:41:34.956219937 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
61852024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
61862024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
61872024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
61882024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61892024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
61902024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61912024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61922024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
61932024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61942024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61952024-09-05T00:51:34.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61962024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
61972024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
61982024-09-05T00:51:34.957ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59
61992024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62002024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
62012024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62022024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.351\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59"}
62032024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
62042024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
62052024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62062024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
62072024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62082024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62092024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
62102024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
62112024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62122024-09-05T00:51:34.957ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
62132024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62142024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
62152024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62162024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
62172024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
62182024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62192024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62202024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
62212024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62222024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62232024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
62242024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62252024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62262024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62272024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62282024-09-05T00:51:34.957ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("145d6d08-bb1c-4557-af3d-b3b8e647b114.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4aa18504-a7e8-4aa1-94fe-a65abab62a4b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("4aa18504-a7e8-4aa1-94fe-a65abab62a4b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3957, tv_nsec: 21703916 } })
62292024-09-05T00:51:34.957ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0c51ae87-cbaf-4403-8e7a-91ae1f6a480f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("89145bfe-85a8-47ae-9826-e73f4757fe92.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("972980d1-78ce-4b3e-8b23-36e1a0e30ffb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("972980d1-78ce-4b3e-8b23-36e1a0e30ffb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 3957, tv_nsec: 21713497 } })
62302024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62312024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62322024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62332024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62342024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62352024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62362024-09-05T00:51:34.957ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62372024-09-05T00:51:34.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62382024-09-05T00:51:34.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62392024-09-05T00:51:34.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62402024-09-05T00:51:34.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62412024-09-05T00:51:34.958ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62422024-09-05T00:51:34.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62432024-09-05T00:51:34.958ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62442024-09-05T00:51:34.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62452024-09-05T00:51:34.958ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62462024-09-05T00:51:34.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62472024-09-05T00:51:34.958ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62482024-09-05T00:51:34.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62492024-09-05T00:51:34.959ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.245138ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62502024-09-05T00:51:34.959ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
62512024-09-05T00:51:34.959ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.741387ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
62522024-09-05T00:51:34.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62532024-09-05T00:51:34.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62542024-09-05T00:51:34.961ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-05 00:41:34.956219937 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
62552024-09-05T00:51:34.961ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.268993ms iteration = 10 status = {"expiration":"2024-09-05T00:41:34.956219937Z","pruned":[]}
62562024-09-05T00:51:34.961ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
62572024-09-05T00:51:34.961ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
62582024-09-05T00:51:34.961ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62592024-09-05T00:51:34.961ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62602024-09-05T00:51:34.961ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
62612024-09-05T00:51:34.961ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
62622024-09-05T00:51:34.961ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
62632024-09-05T00:51:34.961ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
62642024-09-05T00:51:34.961ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
62652024-09-05T00:51:34.961ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
62662024-09-05T00:51:34.961ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task started background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:417
62672024-09-05T00:51:34.961ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62682024-09-05T00:51:34.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62692024-09-05T00:51:34.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62702024-09-05T00:51:34.961ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62712024-09-05T00:51:34.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
62722024-09-05T00:51:34.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
62732024-09-05T00:51:34.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62742024-09-05T00:51:34.962ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
62752024-09-05T00:51:34.962ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.098539ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
62762024-09-05T00:51:34.962ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3957, tv_nsec: 26305909 } })
62772024-09-05T00:51:34.962ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3957, tv_nsec: 26332049 } })
62782024-09-05T00:51:34.962ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
62792024-09-05T00:51:34.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62802024-09-05T00:51:34.963ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62812024-09-05T00:51:34.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62822024-09-05T00:51:34.963ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62832024-09-05T00:51:34.963ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62842024-09-05T00:51:34.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62852024-09-05T00:51:34.964ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
62862024-09-05T00:51:34.964ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62872024-09-05T00:51:34.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
62882024-09-05T00:51:34.966ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62892024-09-05T00:51:34.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62902024-09-05T00:51:34.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62912024-09-05T00:51:34.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62922024-09-05T00:51:34.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62932024-09-05T00:51:35.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62942024-09-05T00:51:35.012ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62952024-09-05T00:51:35.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62962024-09-05T00:51:35.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62972024-09-05T00:51:35.014ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62982024-09-05T00:51:35.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
62992024-09-05T00:51:35.015ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63002024-09-05T00:51:35.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63012024-09-05T00:51:35.015ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63022024-09-05T00:51:35.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63032024-09-05T00:51:35.015ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63042024-09-05T00:51:35.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63052024-09-05T00:51:35.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
63062024-09-05T00:51:35.018ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63072024-09-05T00:51:35.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63082024-09-05T00:51:35.018ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
63092024-09-05T00:51:35.018ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63102024-09-05T00:51:35.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63112024-09-05T00:51:35.019ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63122024-09-05T00:51:35.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63132024-09-05T00:51:35.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
63142024-09-05T00:51:35.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63152024-09-05T00:51:35.019ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63162024-09-05T00:51:35.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63172024-09-05T00:51:35.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63182024-09-05T00:51:35.020ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63192024-09-05T00:51:35.020ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63202024-09-05T00:51:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63212024-09-05T00:51:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
63222024-09-05T00:51:35.023ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63232024-09-05T00:51:35.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63242024-09-05T00:51:35.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63252024-09-05T00:51:35.024ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63262024-09-05T00:51:35.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63272024-09-05T00:51:35.025ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.544031ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
63282024-09-05T00:51:35.025ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63292024-09-05T00:51:35.025ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
63302024-09-05T00:51:35.025ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63312024-09-05T00:51:35.025ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63322024-09-05T00:51:35.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63332024-09-05T00:51:35.026ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63342024-09-05T00:51:35.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63352024-09-05T00:51:35.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
63362024-09-05T00:51:35.027ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63372024-09-05T00:51:35.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63382024-09-05T00:51:35.028ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
63392024-09-05T00:51:35.028ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
63402024-09-05T00:51:35.028ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 67.060314ms iteration = 10 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
63412024-09-05T00:51:35.031ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 70.143209ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
63422024-09-05T00:51:35.032ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63432024-09-05T00:51:35.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63442024-09-05T00:51:35.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63452024-09-05T00:51:35.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63462024-09-05T00:51:35.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
63472024-09-05T00:51:35.034ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
63482024-09-05T00:51:35.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
63492024-09-05T00:51:35.035ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63502024-09-05T00:51:35.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63512024-09-05T00:51:35.035ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63522024-09-05T00:51:35.035ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63532024-09-05T00:51:35.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63542024-09-05T00:51:35.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63552024-09-05T00:51:35.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63562024-09-05T00:51:35.037ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-a014d257-275c-449e-a4f4-aef00eab141c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3957, tv_nsec: 101677180 } })
63572024-09-05T00:51:35.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63582024-09-05T00:51:35.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63592024-09-05T00:51:35.038ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
63602024-09-05T00:51:35.039ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63612024-09-05T00:51:35.040ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 82.596341ms iteration = 5 status = {"nsuccess":5}
63622024-09-05T00:51:35.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63632024-09-05T00:51:35.040ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63642024-09-05T00:51:35.041ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63652024-09-05T00:51:35.042ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63662024-09-05T00:51:35.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63672024-09-05T00:51:35.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63682024-09-05T00:51:35.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63692024-09-05T00:51:35.044ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63702024-09-05T00:51:35.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63712024-09-05T00:51:35.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
63722024-09-05T00:51:35.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63732024-09-05T00:51:35.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63742024-09-05T00:51:35.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
63752024-09-05T00:51:35.045ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63762024-09-05T00:51:35.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63772024-09-05T00:51:35.058ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
63782024-09-05T00:51:35.058ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 101.419636ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
63792024-09-05T00:51:35.061ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
63802024-09-05T00:51:35.061ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
63812024-09-05T00:51:35.061ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
63822024-09-05T00:51:35.061ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63832024-09-05T00:51:35.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63842024-09-05T00:51:35.063ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63852024-09-05T00:51:35.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 107.196859ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63862024-09-05T00:51:35.065ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
63872024-09-05T00:51:35.065ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
63882024-09-05T00:51:35.065ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
63892024-09-05T00:51:35.065ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63902024-09-05T00:51:35.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63912024-09-05T00:51:35.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63922024-09-05T00:51:35.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63932024-09-05T00:51:35.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63942024-09-05T00:51:35.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63952024-09-05T00:51:35.069ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63962024-09-05T00:51:35.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63972024-09-05T00:51:35.069ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
63982024-09-05T00:51:35.069ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 59a6be26-b8fa-4e7a-8244-7a4e92426c26 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
63992024-09-05T00:51:35.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64002024-09-05T00:51:35.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64012024-09-05T00:51:35.070ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64022024-09-05T00:51:35.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64032024-09-05T00:51:35.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64042024-09-05T00:51:35.071ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64052024-09-05T00:51:35.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64062024-09-05T00:51:35.071ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64072024-09-05T00:51:35.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64082024-09-05T00:51:35.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64092024-09-05T00:51:35.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.74222ms iteration = 19 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
64102024-09-05T00:51:35.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 111.783201ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
64112024-09-05T00:51:35.073ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
64122024-09-05T00:51:35.073ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
64132024-09-05T00:51:35.073ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 116.28462ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
64142024-09-05T00:51:35.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64152024-09-05T00:51:35.074ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64162024-09-05T00:51:35.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64172024-09-05T00:51:35.076ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64182024-09-05T00:51:35.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: a014d257-275c-449e-a4f4-aef00eab141c, lookup_type: ById(a014d257-275c-449e-a4f4-aef00eab141c) } result = Ok(())
64192024-09-05T00:51:35.079ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64202024-09-05T00:51:35.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64212024-09-05T00:51:35.080ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 59a6be26-b8fa-4e7a-8244-7a4e92426c26 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
64222024-09-05T00:51:35.080ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
64232024-09-05T00:51:35.080ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-05 00:42:43.011780 UTC dns_group = internal generation = 1
64242024-09-05T00:51:35.080ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 124.75604ms iteration = 11 status = {"generation":1}
64252024-09-05T00:51:35.081ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 123.674761ms iteration = 22 status = {"physical_disks_added":0}
64262024-09-05T00:51:35.081ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 123.873585ms iteration = 19 status = 0
64272024-09-05T00:51:35.085ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
64282024-09-05T00:51:35.085ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
64292024-09-05T00:51:35.085ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 128.343604ms iteration = 19 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
64302024-09-05T00:51:35.086ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64312024-09-05T00:51:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64322024-09-05T00:51:35.092ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64332024-09-05T00:51:35.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64342024-09-05T00:51:35.101ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
64352024-09-05T00:51:35.101ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 32541e10-8a85-4410-9858-67a9ab52251d dns_zone_name = oxide.test found_so_far = 0 version = 2
64362024-09-05T00:51:35.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64372024-09-05T00:51:35.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64382024-09-05T00:51:35.102ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
64392024-09-05T00:51:35.102ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64402024-09-05T00:51:35.102ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1666a419-6b08-476f-b16f-bda0b124818f", "content-length": "26", "date": "Thu, 05 Sep 2024 00:51:34 GMT"} })
64412024-09-05T00:51:35.103ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64422024-09-05T00:51:35.103ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64432024-09-05T00:51:35.104ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64442024-09-05T00:51:35.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64452024-09-05T00:51:35.106ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
64462024-09-05T00:51:35.106ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64472024-09-05T00:51:35.106ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 148.951981ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
64482024-09-05T00:51:35.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64492024-09-05T00:51:35.110ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64502024-09-05T00:51:35.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64512024-09-05T00:51:35.110ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 32541e10-8a85-4410-9858-67a9ab52251d dns_zone_name = oxide.test found_so_far = 1 version = 2
64522024-09-05T00:51:35.111ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
64532024-09-05T00:51:35.111ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-05 00:42:43.837540 UTC dns_group = external generation = 2
64542024-09-05T00:51:35.111ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 154.713634ms iteration = 11 status = {"generation":2}
64552024-09-05T00:51:35.120ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64562024-09-05T00:51:35.121ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
64572024-09-05T00:51:35.121ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64582024-09-05T00:51:35.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64592024-09-05T00:51:35.139ZINFOnexus (BackgroundTasks): region snapshot replacement find affected volumes task done background_task = region_snapshot_replacement_step file = nexus/src/app/background/tasks/region_snapshot_replacement_step.rs:439
64602024-09-05T00:51:35.139ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 177.761014ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
64612024-09-05T00:51:35.161ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
64622024-09-05T00:51:35.161ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64632024-09-05T00:51:35.161ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ad7d0d1f-691d-4f83-bb7f-a56945d15312", "content-length": "26", "date": "Thu, 05 Sep 2024 00:51:34 GMT"} })
64642024-09-05T00:51:35.161ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64652024-09-05T00:51:35.161ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-05T00:42:33.143008Z, time_modified: 2024-09-05T00:42:33.143008Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2d4fccaa-0031-45b8-a053-9531608bab06, db_silo: Silo { identity: SiloIdentity { id: 2d4fccaa-0031-45b8-a053-9531608bab06, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-05T00:42:43.791199Z, time_modified: 2024-09-05T00:42:43.791199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2d4fccaa-0031-45b8-a053-9531608bab06, db_silo: Silo { identity: SiloIdentity { id: 2d4fccaa-0031-45b8-a053-9531608bab06, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-05T00:42:43.791199Z, time_modified: 2024-09-05T00:42:43.791199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017" }] }) }
64662024-09-05T00:51:35.161ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 205.722942ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2d4fccaa-0031-45b8-a053-9531608bab06","tls_certs":["a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017"]}},"default_endpoint":{"silo_id":"2d4fccaa-0031-45b8-a053-9531608bab06","tls_certs":["a72f83470fe9a690dd37684c27f2286b8acd7974ecb7468e67cb1a98ce9a8017"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
64672024-09-05T00:51:35.163ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64682024-09-05T00:51:35.179ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64692024-09-05T00:51:35.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64702024-09-05T00:51:35.181ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64712024-09-05T00:51:35.183ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64722024-09-05T00:51:35.183ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64732024-09-05T00:51:35.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64742024-09-05T00:51:35.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64752024-09-05T00:51:35.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64762024-09-05T00:51:35.187ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64772024-09-05T00:51:35.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64782024-09-05T00:51:35.223ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
64792024-09-05T00:51:35.269ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
64802024-09-05T00:51:35.269ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 35b2c8c6-b9cd-46a1-9a35-6ffa1234d139 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
64812024-09-05T00:51:35.288ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64822024-09-05T00:51:35.291ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e7c38a12-ba35-4497-b795-c499bf82fea2", "content-length": "372", "date": "Thu, 05 Sep 2024 00:51:35 GMT"} })
64832024-09-05T00:51:35.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64842024-09-05T00:51:35.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64852024-09-05T00:51:35.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64862024-09-05T00:51:35.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64872024-09-05T00:51:35.320ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 364.720912ms iteration = 19 status = {}
64882024-09-05T00:51:35.332ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b zone_address = fd00:1122:3344:101::2
64892024-09-05T00:51:35.332ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64902024-09-05T00:51:35.332ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "825ed045-4cff-4814-8dbd-0b201e10764e", "content-length": "26", "date": "Thu, 05 Sep 2024 00:51:34 GMT"} })
64912024-09-05T00:51:35.332ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64922024-09-05T00:51:35.334ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
64932024-09-05T00:51:35.391ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64942024-09-05T00:51:35.392ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "587a7095-ab01-478c-b528-9ba89166c44c", "content-length": "691", "date": "Thu, 05 Sep 2024 00:51:34 GMT"} })
64952024-09-05T00:51:35.392ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
64962024-09-05T00:51:35.392ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
64972024-09-05T00:51:35.392ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
64982024-09-05T00:51:35.393ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 436.273237ms iteration = 20 status = {}
64992024-09-05T00:51:35.394ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65002024-09-05T00:51:35.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65012024-09-05T00:51:35.398ZDEBGnexus (BackgroundTasks): client request SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65022024-09-05T00:51:35.398ZDEBGnexus (BackgroundTasks): client response SledAgent = a014d257-275c-449e-a4f4-aef00eab141c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "17f98ef2-4ee1-4193-8b7a-da1f43ac474c", "date": "Thu, 05 Sep 2024 00:51:34 GMT"} })
65032024-09-05T00:51:35.399ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 442.304424ms iteration = 21 status = {}
65042024-09-05T00:51:35.409ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
65052024-09-05T00:51:35.409ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5f90de0d-b4ef-4816-8723-970fb01fd5c9", "content-length": "2", "date": "Thu, 05 Sep 2024 00:51:35 GMT"} })
65062024-09-05T00:51:35.410ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65072024-09-05T00:51:35.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65082024-09-05T00:51:35.412ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 456.631289ms iteration = 19 status = null
65092024-09-05T00:51:35.491ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
65102024-09-05T00:51:35.492ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "25f228cd-5541-4c24-a998-ee681856b9a9", "date": "Thu, 05 Sep 2024 00:51:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65112024-09-05T00:51:35.492ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65122024-09-05T00:51:35.493ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6f523ead-8e51-402a-92f9-c7debf0ff659", "date": "Thu, 05 Sep 2024 00:51:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65132024-09-05T00:51:35.493ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65142024-09-05T00:51:35.495ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
65152024-09-05T00:51:35.495ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 539.29238ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
65162024-09-05T00:51:35.495ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
65172024-09-05T00:51:35.534ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
65182024-09-05T00:51:35.534ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "263ff283-7b4c-479a-923b-fa775d756708", "date": "Thu, 05 Sep 2024 00:51:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
65192024-09-05T00:51:35.534ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
65202024-09-05T00:51:35.536ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f87b18c4-f232-4142-a46e-5877ced27603", "date": "Thu, 05 Sep 2024 00:51:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
65212024-09-05T00:51:35.536ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
65222024-09-05T00:51:35.538ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "65352689-4721-4604-a707-ce65b87ac432", "date": "Thu, 05 Sep 2024 00:51:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
65232024-09-05T00:51:35.538ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
65242024-09-05T00:51:35.539ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
65252024-09-05T00:51:35.539ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 583.442487ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
65262024-09-05T00:51:35.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65272024-09-05T00:51:35.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65282024-09-05T00:51:35.547ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 3013d0b1-47fb-4df1-97e5-7049d1043033, rack_id: be337c62-4580-4975-a5e7-eb97e51b444b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5c4762fe-488f-4054-979a-f54d371ea654) } rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
65292024-09-05T00:51:35.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65302024-09-05T00:51:35.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65312024-09-05T00:51:35.556ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
65322024-09-05T00:51:35.557ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e4fa6b10-db89-4b6a-82ca-0f597f7cd9ff", "content-length": "121", "date": "Thu, 05 Sep 2024 00:51:35 GMT"} })
65332024-09-05T00:51:35.557ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
65342024-09-05T00:51:35.557ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5c4762fe-488f-4054-979a-f54d371ea654
65352024-09-05T00:51:35.557ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
65362024-09-05T00:51:35.557ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
65372024-09-05T00:51:35.557ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
65382024-09-05T00:51:35.557ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b routes = {}
65392024-09-05T00:51:35.557ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b
65402024-09-05T00:51:35.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65412024-09-05T00:51:35.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65422024-09-05T00:51:35.559ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
65432024-09-05T00:51:35.559ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "30628df7-a3d8-4d48-8709-e943c057f312", "content-length": "2", "date": "Thu, 05 Sep 2024 00:51:35 GMT"} })
65442024-09-05T00:51:35.559ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
65452024-09-05T00:51:35.559ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "02ab9edf-d268-465c-bfd8-bfc11c928ef9", "content-length": "51", "date": "Thu, 05 Sep 2024 00:51:35 GMT"} })
65462024-09-05T00:51:35.559ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch_location = Switch0
65472024-09-05T00:51:35.559ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
65482024-09-05T00:51:35.649ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6c240d16-e1f3-476f-afbc-1bda149d50f6", "date": "Thu, 05 Sep 2024 00:51:34 GMT"} })
65492024-09-05T00:51:35.650ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = be337c62-4580-4975-a5e7-eb97e51b444b switch = Switch0
65502024-09-05T00:51:35.650ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = be337c62-4580-4975-a5e7-eb97e51b444b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
65512024-09-05T00:51:35.650ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = be337c62-4580-4975-a5e7-eb97e51b444b result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "665bdbcf-61af-4ea9-b329-2d38ddef5d83", "content-length": "667", "date": "Thu, 05 Sep 2024 00:51:34 GMT"} })
65522024-09-05T00:51:35.650ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65532024-09-05T00:51:35.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65542024-09-05T00:51:35.654ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65552024-09-05T00:51:35.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65562024-09-05T00:51:35.657ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65572024-09-05T00:51:35.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65582024-09-05T00:51:35.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65592024-09-05T00:51:35.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65602024-09-05T00:51:35.667ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 710.325056ms iteration = 19 status = {}
65612024-09-05T00:51:35.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d4d963e5-2f55-4b45-a7fd-83ec4f9c5790 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65622024-09-05T00:51:35.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d4d963e5-2f55-4b45-a7fd-83ec4f9c5790 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65632024-09-05T00:51:35.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d4d963e5-2f55-4b45-a7fd-83ec4f9c5790 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65642024-09-05T00:51:36.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 85cd6077-71b7-451e-9d24-01a5126cdf04 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65652024-09-05T00:51:36.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 85cd6077-71b7-451e-9d24-01a5126cdf04 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65662024-09-05T00:51:36.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 85cd6077-71b7-451e-9d24-01a5126cdf04 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65672024-09-05T00:51:37.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 348f7610-8d01-43ad-afff-58d8111962a9 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65682024-09-05T00:51:37.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 348f7610-8d01-43ad-afff-58d8111962a9 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65692024-09-05T00:51:37.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2703 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 348f7610-8d01-43ad-afff-58d8111962a9 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65702024-09-05T00:51:38.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 75fbaae4-1258-4d14-b2fc-e0c5ba91c6c0 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65712024-09-05T00:51:38.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 75fbaae4-1258-4d14-b2fc-e0c5ba91c6c0 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65722024-09-05T00:51:38.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2617 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 75fbaae4-1258-4d14-b2fc-e0c5ba91c6c0 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65732024-09-05T00:51:39.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2bc41bb9-55fd-400a-9606-08462e9571ad roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65742024-09-05T00:51:39.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2bc41bb9-55fd-400a-9606-08462e9571ad resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65752024-09-05T00:51:39.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 2bc41bb9-55fd-400a-9606-08462e9571ad response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65762024-09-05T00:51:40.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6795b93b-7f20-45b6-b294-9fe1f430e4fb roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65772024-09-05T00:51:40.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6795b93b-7f20-45b6-b294-9fe1f430e4fb resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65782024-09-05T00:51:40.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 6795b93b-7f20-45b6-b294-9fe1f430e4fb response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65792024-09-05T00:51:42.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8210d2f1-6f39-45cb-90bd-64b0f38153d3 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65802024-09-05T00:51:42.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8210d2f1-6f39-45cb-90bd-64b0f38153d3 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65812024-09-05T00:51:42.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 8210d2f1-6f39-45cb-90bd-64b0f38153d3 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65822024-09-05T00:51:43.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5d2d4cdf-256d-49fa-9100-8320b8153f10 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65832024-09-05T00:51:43.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5d2d4cdf-256d-49fa-9100-8320b8153f10 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65842024-09-05T00:51:43.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 5d2d4cdf-256d-49fa-9100-8320b8153f10 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65852024-09-05T00:51:44.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 39467960-cc51-4106-90a4-8c4a86ca60b7 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65862024-09-05T00:51:44.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 39467960-cc51-4106-90a4-8c4a86ca60b7 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65872024-09-05T00:51:44.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2927 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 39467960-cc51-4106-90a4-8c4a86ca60b7 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
65882024-09-05T00:51:44.958ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
65892024-09-05T00:51:44.958ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
65902024-09-05T00:51:44.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65912024-09-05T00:51:44.958ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65922024-09-05T00:51:44.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65932024-09-05T00:51:44.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65942024-09-05T00:51:44.960ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65952024-09-05T00:51:44.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65962024-09-05T00:51:44.986ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.625139ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65972024-09-05T00:51:44.989ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65982024-09-05T00:51:44.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65992024-09-05T00:51:44.992ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66002024-09-05T00:51:44.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66012024-09-05T00:51:44.994ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66022024-09-05T00:51:44.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66032024-09-05T00:51:44.996ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66042024-09-05T00:51:44.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
66052024-09-05T00:51:44.998ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66062024-09-05T00:51:44.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66072024-09-05T00:51:45.007ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
66082024-09-05T00:51:45.007ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.976862ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
66092024-09-05T00:51:45.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e217cb98-4dde-4c21-825c-8ba4d0fdc0ce roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66102024-09-05T00:51:45.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e217cb98-4dde-4c21-825c-8ba4d0fdc0ce resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66112024-09-05T00:51:45.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = e217cb98-4dde-4c21-825c-8ba4d0fdc0ce response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66122024-09-05T00:51:45.269ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1491 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 76113c60-b7b0-4e53-8168-e4fa4e3e098f response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
66132024-09-05T00:51:46.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fcc16a72-183e-4fc5-b12d-d9974b6ad9cc roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66142024-09-05T00:51:46.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fcc16a72-183e-4fc5-b12d-d9974b6ad9cc resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66152024-09-05T00:51:46.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1894 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = fcc16a72-183e-4fc5-b12d-d9974b6ad9cc response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66162024-09-05T00:51:47.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 33de7128-4843-4ef9-af7d-3ebe3ec9cd81 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66172024-09-05T00:51:47.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 33de7128-4843-4ef9-af7d-3ebe3ec9cd81 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66182024-09-05T00:51:47.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 33de7128-4843-4ef9-af7d-3ebe3ec9cd81 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66192024-09-05T00:51:48.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 35130e8d-9fb1-477f-95d3-c7187cb74837 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66202024-09-05T00:51:48.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 35130e8d-9fb1-477f-95d3-c7187cb74837 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66212024-09-05T00:51:48.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 35130e8d-9fb1-477f-95d3-c7187cb74837 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66222024-09-05T00:51:49.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7ef5a3e0-0f24-4770-8203-1ad509fbe745 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66232024-09-05T00:51:49.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7ef5a3e0-0f24-4770-8203-1ad509fbe745 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66242024-09-05T00:51:49.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 7ef5a3e0-0f24-4770-8203-1ad509fbe745 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66252024-09-05T00:51:50.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 254abcf3-eca7-411b-b866-09e329b93c6e roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66262024-09-05T00:51:50.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 254abcf3-eca7-411b-b866-09e329b93c6e resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66272024-09-05T00:51:50.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 254abcf3-eca7-411b-b866-09e329b93c6e response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66282024-09-05T00:51:51.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d54ce8f9-1e78-47d6-a8e6-33037b0f002c roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66292024-09-05T00:51:51.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d54ce8f9-1e78-47d6-a8e6-33037b0f002c resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66302024-09-05T00:51:51.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = d54ce8f9-1e78-47d6-a8e6-33037b0f002c response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66312024-09-05T00:51:52.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = dccd04ae-b17b-49e5-b6f0-42b3fc0346d0 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66322024-09-05T00:51:52.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = dccd04ae-b17b-49e5-b6f0-42b3fc0346d0 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66332024-09-05T00:51:52.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = dccd04ae-b17b-49e5-b6f0-42b3fc0346d0 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66342024-09-05T00:51:52.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 8d874caa-061b-429a-963d-20768fb9b1fa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
66352024-09-05T00:51:52.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 8d874caa-061b-429a-963d-20768fb9b1fa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
66362024-09-05T00:51:52.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35715 req_id = 8d874caa-061b-429a-963d-20768fb9b1fa response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
66372024-09-05T00:51:53.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1590b97a-9039-4e78-a3df-fd88af395994 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66382024-09-05T00:51:53.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1590b97a-9039-4e78-a3df-fd88af395994 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66392024-09-05T00:51:53.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 1590b97a-9039-4e78-a3df-fd88af395994 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66402024-09-05T00:51:54.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c14d047e-ffbf-4583-b6ad-4a41f69b908b roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66412024-09-05T00:51:54.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c14d047e-ffbf-4583-b6ad-4a41f69b908b resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66422024-09-05T00:51:54.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2494 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = c14d047e-ffbf-4583-b6ad-4a41f69b908b response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66432024-09-05T00:51:54.957ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
66442024-09-05T00:51:54.957ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
66452024-09-05T00:51:54.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66462024-09-05T00:51:54.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66472024-09-05T00:51:54.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66482024-09-05T00:51:54.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66492024-09-05T00:51:54.959ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66502024-09-05T00:51:54.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66512024-09-05T00:51:54.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66522024-09-05T00:51:54.961ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.219277ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66532024-09-05T00:51:54.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66542024-09-05T00:51:54.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66552024-09-05T00:51:54.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66562024-09-05T00:51:54.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66572024-09-05T00:51:54.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66582024-09-05T00:51:54.966ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66592024-09-05T00:51:54.968ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2f5076a4-3a1d-44b2-b936-5f24f25a2c59, lookup_type: ById(2f5076a4-3a1d-44b2-b936-5f24f25a2c59) } result = Ok(())
66602024-09-05T00:51:54.968ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66612024-09-05T00:51:54.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66622024-09-05T00:51:54.976ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 original_time_created = 2024-09-05 00:42:14.103467 UTC target_id = 2f5076a4-3a1d-44b2-b936-5f24f25a2c59 time_created = 2024-09-05 00:42:14.103467 UTC
66632024-09-05T00:51:54.976ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.442759ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2f5076a4-3a1d-44b2-b936-5f24f25a2c59","time_created":"2024-09-05T00:42:14.103467Z"}
66642024-09-05T00:51:55.269ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1878 local_addr = [fd00:1122:3344:101::b]:42287 method = GET remote_addr = [fd00:1122:3344:101::d]:63567 req_id = 24ae3d54-533d-45e5-a388-ba439808cd39 response_code = 200 uri = /5f1fb376-349f-4b39-808a-5aa5abc60b1e
66652024-09-05T00:51:55.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 82164916-447b-4b1c-b7fc-bcae5d582349 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66662024-09-05T00:51:55.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 82164916-447b-4b1c-b7fc-bcae5d582349 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66672024-09-05T00:51:55.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 82164916-447b-4b1c-b7fc-bcae5d582349 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66682024-09-05T00:51:56.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9512a4f2-4b45-4593-98c9-21e03c61a41c roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66692024-09-05T00:51:56.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9512a4f2-4b45-4593-98c9-21e03c61a41c resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66702024-09-05T00:51:56.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 9512a4f2-4b45-4593-98c9-21e03c61a41c response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66712024-09-05T00:51:57.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0d38f2ab-fe76-4d9d-95a2-987f10f04e08 roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66722024-09-05T00:51:57.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0d38f2ab-fe76-4d9d-95a2-987f10f04e08 resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66732024-09-05T00:51:57.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2690 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = 0d38f2ab-fe76-4d9d-95a2-987f10f04e08 response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66742024-09-05T00:51:58.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b77850cd-47ab-4cb5-bfdf-657bdac0dacf roles = RoleSet { roles: {} } uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66752024-09-05T00:51:58.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b77850cd-47ab-4cb5-bfdf-657bdac0dacf resource = Database result = Ok(()) uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c
66762024-09-05T00:51:58.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63983 req_id = b77850cd-47ab-4cb5-bfdf-657bdac0dacf response_code = 200 uri = /probes/a014d257-275c-449e-a4f4-aef00eab141c