Max level shown:
12024-04-30T22:30:06.756ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 769 local_addr = [fd00:1122:3344:101::c]:50486 method = GET remote_addr = [fd00:1122:3344:101::d]:53271 req_id = 0cc038fa-2322-43d6-acb2-fe0f8eaf79fe response_code = 200 uri = //420a9926-428f-4a96-ac2a-14aba90f476b
22024-04-30T22:30:10.250ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
32024-04-30T22:30:10.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42024-04-30T22:30:10.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52024-04-30T22:30:10.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62024-04-30T22:30:10.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72024-04-30T22:30:10.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82024-04-30T22:30:10.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92024-04-30T22:30:10.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102024-04-30T22:30:10.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112024-04-30T22:30:10.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122024-04-30T22:30:10.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d44818d7-9574-4d1c-b279-50b469bf5d65, lookup_type: ById(d44818d7-9574-4d1c-b279-50b469bf5d65) } result = Ok(())
132024-04-30T22:30:10.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142024-04-30T22:30:10.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
152024-04-30T22:30:10.267ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 original_time_created = 2024-04-30 22:22:49.833425 UTC target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 time_created = 2024-04-30 22:22:49.833425 UTC
162024-04-30T22:30:10.267ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.255675ms iteration = 45
172024-04-30T22:30:16.755ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 510 local_addr = [fd00:1122:3344:101::c]:50486 method = GET remote_addr = [fd00:1122:3344:101::d]:53271 req_id = 457baeb9-67b2-4d21-ab8f-d6bb069fb032 response_code = 200 uri = //420a9926-428f-4a96-ac2a-14aba90f476b
182024-04-30T22:30:20.249ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
192024-04-30T22:30:20.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
202024-04-30T22:30:20.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
212024-04-30T22:30:20.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
222024-04-30T22:30:20.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
232024-04-30T22:30:20.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
242024-04-30T22:30:20.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
252024-04-30T22:30:20.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
262024-04-30T22:30:20.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
272024-04-30T22:30:20.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
282024-04-30T22:30:20.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d44818d7-9574-4d1c-b279-50b469bf5d65, lookup_type: ById(d44818d7-9574-4d1c-b279-50b469bf5d65) } result = Ok(())
292024-04-30T22:30:20.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
302024-04-30T22:30:20.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
312024-04-30T22:30:20.266ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 original_time_created = 2024-04-30 22:22:49.833425 UTC target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 time_created = 2024-04-30 22:22:49.833425 UTC
322024-04-30T22:30:20.266ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.833394ms iteration = 46
332024-04-30T22:30:26.756ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 751 local_addr = [fd00:1122:3344:101::c]:50486 method = GET remote_addr = [fd00:1122:3344:101::d]:53271 req_id = 7a1411dd-c054-44a1-b9d8-dc6ba5650734 response_code = 200 uri = //420a9926-428f-4a96-ac2a-14aba90f476b
342024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
352024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
362024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
372024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
382024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
392024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
402024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
412024-04-30T22:30:30.250ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:46
422024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
432024-04-30T22:30:30.250ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/region_replacement.rs:44
442024-04-30T22:30:30.250ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/region_replacement.rs:48
452024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
462024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 7.57\u{b5}s iteration = 17
472024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
482024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
492024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
502024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
512024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
522024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
532024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
542024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
552024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
562024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
572024-04-30T22:30:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
582024-04-30T22:30:30.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
592024-04-30T22:30:30.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
602024-04-30T22:30:30.252ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 5074, tv_nsec: 134035519 } })
612024-04-30T22:30:30.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
622024-04-30T22:30:30.252ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
632024-04-30T22:30:30.252ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1003
642024-04-30T22:30:30.252ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:92
652024-04-30T22:30:30.252ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.724449ms iteration = 17
662024-04-30T22:30:30.254ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 5074, tv_nsec: 135715531 } })
672024-04-30T22:30:30.254ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1003
682024-04-30T22:30:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
692024-04-30T22:30:30.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
702024-04-30T22:30:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
712024-04-30T22:30:30.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
722024-04-30T22:30:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
732024-04-30T22:30:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
742024-04-30T22:30:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
752024-04-30T22:30:30.256ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
762024-04-30T22:30:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
772024-04-30T22:30:30.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
782024-04-30T22:30:30.257ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
792024-04-30T22:30:30.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
802024-04-30T22:30:30.258ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/physical_disk_adoption.rs:100
812024-04-30T22:30:30.258ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
822024-04-30T22:30:30.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
832024-04-30T22:30:30.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
842024-04-30T22:30:30.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
852024-04-30T22:30:30.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
862024-04-30T22:30:30.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
872024-04-30T22:30:30.258ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 5074, tv_nsec: 140601214 } })
882024-04-30T22:30:30.259ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1003 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9
892024-04-30T22:30:30.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
902024-04-30T22:30:30.260ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
912024-04-30T22:30:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
922024-04-30T22:30:30.262ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
932024-04-30T22:30:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
942024-04-30T22:30:30.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d44818d7-9574-4d1c-b279-50b469bf5d65, lookup_type: ById(d44818d7-9574-4d1c-b279-50b469bf5d65) } result = Ok(())
952024-04-30T22:30:30.263ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
962024-04-30T22:30:30.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
972024-04-30T22:30:30.266ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/physical_disk_adoption.rs:174
982024-04-30T22:30:30.266ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 16.2717ms iteration = 20
992024-04-30T22:30:30.268ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 original_time_created = 2024-04-30 22:22:49.833425 UTC target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 time_created = 2024-04-30 22:22:49.833425 UTC
1002024-04-30T22:30:30.268ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.075956ms iteration = 47
1012024-04-30T22:30:30.269ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1022024-04-30T22:30:30.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1032024-04-30T22:30:30.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1042024-04-30T22:30:30.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1052024-04-30T22:30:30.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1062024-04-30T22:30:30.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a52263-53ab-4221-9c03-9637ab9d1295, lookup_type: ById(03a52263-53ab-4221-9c03-9637ab9d1295) } result = Ok(())
1072024-04-30T22:30:30.274ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1082024-04-30T22:30:30.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1092024-04-30T22:30:30.275ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 25.404891ms iteration = 17
1102024-04-30T22:30:30.325ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1011 zone_address = fd00:1122:3344:101::2
1112024-04-30T22:30:30.325ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1122024-04-30T22:30:30.326ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9b4f2844-56bf-49f2-9670-d62a714a43d4", "content-length": "26", "date": "Tue, 30 Apr 2024 22:30:29 GMT"} })
1132024-04-30T22:30:30.326ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1016 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1142024-04-30T22:30:30.328ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1048 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1152024-04-30T22:30:30.330ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1011 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 zone_address = fd00:1122:3344:101::2
1162024-04-30T22:30:30.330ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1172024-04-30T22:30:30.330ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e2528cb4-ad2e-41ae-91b4-ddafa686ae2b", "content-length": "26", "date": "Tue, 30 Apr 2024 22:30:29 GMT"} })
1182024-04-30T22:30:30.330ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1016 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1192024-04-30T22:30:30.330ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1011 zone_address = fd00:1122:3344:101::2
1202024-04-30T22:30:30.330ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1212024-04-30T22:30:30.331ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5632409c-dd2d-437c-93e3-870c9508b504", "content-length": "26", "date": "Tue, 30 Apr 2024 22:30:29 GMT"} })
1222024-04-30T22:30:30.331ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1016 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1232024-04-30T22:30:30.332ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1048 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9
1242024-04-30T22:30:30.332ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1048 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1252024-04-30T22:30:30.407ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
1262024-04-30T22:30:30.408ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e4552909-8a2b-4cf3-83e6-2e6fb9b58036", "content-length": "2", "date": "Tue, 30 Apr 2024 22:30:29 GMT"} })
1272024-04-30T22:30:30.408ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 158.668612ms iteration = 17
1282024-04-30T22:30:30.409ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1292024-04-30T22:30:30.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1302024-04-30T22:30:30.411ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 161.147045ms iteration = 17
1312024-04-30T22:30:30.467ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1322024-04-30T22:30:30.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1332024-04-30T22:30:30.469ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:141 port = SwitchPort { id: c0fb5468-b775-440a-b7cd-a2f94bb7a497, rack_id: cbc2e9a2-a4c8-47b8-a5d7-5151055087a9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(43426b1c-50e4-4799-808f-f59c4802b264) } rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 switch_location = Switch0
1342024-04-30T22:30:30.469ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1352024-04-30T22:30:30.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1362024-04-30T22:30:30.477ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
1372024-04-30T22:30:30.478ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2ed1d41a-3bdd-483c-b4e8-d2855a84da9d", "content-length": "121", "date": "Tue, 30 Apr 2024 22:30:29 GMT"} })
1382024-04-30T22:30:30.478ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:1418 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
1392024-04-30T22:30:30.478ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:1445 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 43426b1c-50e4-4799-808f-f59c4802b264
1402024-04-30T22:30:30.478ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:364 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 })}}
1412024-04-30T22:30:30.478ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:368 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 })}}
1422024-04-30T22:30:30.478ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:377 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 routes = {}
1432024-04-30T22:30:30.478ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:383 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 routes = {}
1442024-04-30T22:30:30.478ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:403 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9
1452024-04-30T22:30:30.478ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1462024-04-30T22:30:30.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1472024-04-30T22:30:30.479ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
1482024-04-30T22:30:30.480ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "68a82966-d048-41e0-a409-7fa3f8734479", "content-length": "2", "date": "Tue, 30 Apr 2024 22:30:29 GMT"} })
1492024-04-30T22:30:30.480ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
1502024-04-30T22:30:30.480ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "146cb1a3-de55-4f27-949e-2efa231faafd", "content-length": "52", "date": "Tue, 30 Apr 2024 22:30:29 GMT"} })
1512024-04-30T22:30:30.480ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [V4(Ipv4Network { addr: 10.151.2.174, prefix: 24 })], port: "qsfp0" }] file = nexus/src/app/background/sync_switch_configuration.rs:452 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 switch_location = Switch0
1522024-04-30T22:30:30.480ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
1532024-04-30T22:30:30.529ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3c665746-fdd5-40a0-a629-2a28e6ca6c6f", "date": "Tue, 30 Apr 2024 22:30:30 GMT"} })
1542024-04-30T22:30:30.529ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:617 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 switch = Switch0
1552024-04-30T22:30:30.529ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
1562024-04-30T22:30:30.529ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b2a21001-da8f-4b40-ba9b-5813bc7737e7", "content-length": "452", "date": "Tue, 30 Apr 2024 22:30:30 GMT"} })
1572024-04-30T22:30:30.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1582024-04-30T22:30:30.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1592024-04-30T22:30:30.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1602024-04-30T22:30:30.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1612024-04-30T22:30:30.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1622024-04-30T22:30:30.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1632024-04-30T22:30:30.536ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1642024-04-30T22:30:30.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1652024-04-30T22:30:30.543ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 293.214517ms iteration = 17
1662024-04-30T22:30:36.757ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 1515 local_addr = [fd00:1122:3344:101::c]:50486 method = GET remote_addr = [fd00:1122:3344:101::d]:53271 req_id = a820db19-a573-4367-802f-9250ef593148 response_code = 200 uri = //420a9926-428f-4a96-ac2a-14aba90f476b
1672024-04-30T22:30:36.758ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
1682024-04-30T22:30:36.758ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
1692024-04-30T22:30:36.788ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
1702024-04-30T22:30:36.788ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:62897
1712024-04-30T22:30:36.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62897 req_id = 60dcd6b1-27a3-4fbe-958e-234072102b56 roles = RoleSet { roles: {} } uri = /metrics/producers
1722024-04-30T22:30:36.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62897 req_id = 60dcd6b1-27a3-4fbe-958e-234072102b56 resource = Database result = Ok(()) uri = /metrics/producers
1732024-04-30T22:30:36.820ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 2584e6b7-8bd3-4591-b4dd-c3d456b7896a
1742024-04-30T22:30:36.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62897 req_id = 60dcd6b1-27a3-4fbe-958e-234072102b56 roles = RoleSet { roles: {} } uri = /metrics/producers
1752024-04-30T22:30:36.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62897 req_id = 60dcd6b1-27a3-4fbe-958e-234072102b56 resource = Database result = Ok(()) uri = /metrics/producers
1762024-04-30T22:30:36.847ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 2584e6b7-8bd3-4591-b4dd-c3d456b7896a uri = http://[fd00:1122:3344:101::d]:12223/producers
1772024-04-30T22:30:36.847ZDEBGnexus: client response oximeter-collector = 2584e6b7-8bd3-4591-b4dd-c3d456b7896a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f453ea54-b71b-4d98-8ca8-ce29d7bfd4ea", "date": "Tue, 30 Apr 2024 22:30:36 GMT"} })
1782024-04-30T22:30:36.847ZINFOnexus: assigned collector to new producer collector_id = 2584e6b7-8bd3-4591-b4dd-c3d456b7896a file = nexus/src/app/oximeter.rs:125 producer_id = 420a9926-428f-4a96-ac2a-14aba90f476b
1792024-04-30T22:30:36.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 60762 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:62897 req_id = 60dcd6b1-27a3-4fbe-958e-234072102b56 response_code = 201 uri = /metrics/producers
1802024-04-30T22:30:36.849ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "60dcd6b1-27a3-4fbe-958e-234072102b56", "content-length": "41", "date": "Tue, 30 Apr 2024 22:30:36 GMT"} })
1812024-04-30T22:30:36.851ZDEBGnexus (producer-registration-task): registered with nexus successfully
1822024-04-30T22:30:36.851ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
1832024-04-30T22:30:40.250ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
1842024-04-30T22:30:40.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1852024-04-30T22:30:40.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1862024-04-30T22:30:40.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1872024-04-30T22:30:40.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1882024-04-30T22:30:40.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1892024-04-30T22:30:40.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1902024-04-30T22:30:40.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1912024-04-30T22:30:40.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1922024-04-30T22:30:40.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1932024-04-30T22:30:40.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d44818d7-9574-4d1c-b279-50b469bf5d65, lookup_type: ById(d44818d7-9574-4d1c-b279-50b469bf5d65) } result = Ok(())
1942024-04-30T22:30:40.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1952024-04-30T22:30:40.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1962024-04-30T22:30:40.267ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 original_time_created = 2024-04-30 22:22:49.833425 UTC target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 time_created = 2024-04-30 22:22:49.833425 UTC
1972024-04-30T22:30:40.267ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.998129ms iteration = 48
1982024-04-30T22:30:46.849ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 1112 local_addr = [fd00:1122:3344:101::c]:50486 method = GET remote_addr = [fd00:1122:3344:101::d]:53271 req_id = fd95ce6d-13b0-4729-b3b9-7fa310f2cd16 response_code = 200 uri = //420a9926-428f-4a96-ac2a-14aba90f476b
1992024-04-30T22:30:50.249ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
2002024-04-30T22:30:50.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2012024-04-30T22:30:50.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2022024-04-30T22:30:50.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2032024-04-30T22:30:50.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2042024-04-30T22:30:50.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2052024-04-30T22:30:50.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2062024-04-30T22:30:50.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2072024-04-30T22:30:50.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2082024-04-30T22:30:50.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2092024-04-30T22:30:50.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d44818d7-9574-4d1c-b279-50b469bf5d65, lookup_type: ById(d44818d7-9574-4d1c-b279-50b469bf5d65) } result = Ok(())
2102024-04-30T22:30:50.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2112024-04-30T22:30:50.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2122024-04-30T22:30:50.266ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 original_time_created = 2024-04-30 22:22:49.833425 UTC target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 time_created = 2024-04-30 22:22:49.833425 UTC
2132024-04-30T22:30:50.266ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.500497ms iteration = 49
2142024-04-30T22:30:50.844ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:765 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:45105
2152024-04-30T22:30:50.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45105 req_id = 2058e834-e826-4b9a-b97c-fd98de155ffd roles = RoleSet { roles: {} } uri = /metrics/producers
2162024-04-30T22:30:50.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45105 req_id = 2058e834-e826-4b9a-b97c-fd98de155ffd resource = Database result = Ok(()) uri = /metrics/producers
2172024-04-30T22:30:50.876ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 2584e6b7-8bd3-4591-b4dd-c3d456b7896a
2182024-04-30T22:30:50.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45105 req_id = 2058e834-e826-4b9a-b97c-fd98de155ffd roles = RoleSet { roles: {} } uri = /metrics/producers
2192024-04-30T22:30:50.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45105 req_id = 2058e834-e826-4b9a-b97c-fd98de155ffd resource = Database result = Ok(()) uri = /metrics/producers
2202024-04-30T22:30:50.883ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 2584e6b7-8bd3-4591-b4dd-c3d456b7896a uri = http://[fd00:1122:3344:101::d]:12223/producers
2212024-04-30T22:30:50.883ZDEBGnexus: client response oximeter-collector = 2584e6b7-8bd3-4591-b4dd-c3d456b7896a result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0f6c0f8a-1a1c-4bea-a4a1-019a5dd9c4a5", "date": "Tue, 30 Apr 2024 22:30:50 GMT"} })
2222024-04-30T22:30:50.883ZINFOnexus: assigned collector to new producer collector_id = 2584e6b7-8bd3-4591-b4dd-c3d456b7896a file = nexus/src/app/oximeter.rs:125 producer_id = 03a52263-53ab-4221-9c03-9637ab9d1295
2232024-04-30T22:30:50.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 40844 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45105 req_id = 2058e834-e826-4b9a-b97c-fd98de155ffd response_code = 201 uri = /metrics/producers
2242024-04-30T22:30:56.848ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 426 local_addr = [fd00:1122:3344:101::c]:50486 method = GET remote_addr = [fd00:1122:3344:101::d]:53271 req_id = 90095b15-2413-4774-a8c4-bb8c3e2725cd response_code = 200 uri = //420a9926-428f-4a96-ac2a-14aba90f476b
2252024-04-30T22:31:00.248ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
2262024-04-30T22:31:00.248ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
2272024-04-30T22:31:00.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2282024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2292024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2302024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
2312024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
2322024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
2332024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
2342024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2352024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2362024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
2372024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
2382024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
2392024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2402024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
2412024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2422024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
2432024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
2442024-04-30T22:31:00.249ZWARNnexus (BackgroundTasks): Metric producer GC: statically disabled pending omicron#5284 background_task = metrics_producer_gc file = nexus/src/app/background/metrics_producer_gc.rs:43
2452024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
2462024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.41\u{b5}s iteration = 10
2472024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
2482024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
2492024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
2502024-04-30T22:31:00.249ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/blueprint_execution.rs:65 reason = blueprint disabled target_id = d44818d7-9574-4d1c-b279-50b469bf5d65
2512024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2522024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.62\u{b5}s iteration = 11
2532024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2542024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
2552024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
2562024-04-30T22:31:00.249ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:46
2572024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
2582024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2592024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
2602024-04-30T22:31:00.249ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/region_replacement.rs:44
2612024-04-30T22:31:00.249ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/region_replacement.rs:48
2622024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 6.92\u{b5}s iteration = 18
2632024-04-30T22:31:00.249ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2642024-04-30T22:31:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2652024-04-30T22:31:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2662024-04-30T22:31:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
2672024-04-30T22:31:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2682024-04-30T22:31:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2692024-04-30T22:31:00.250ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b369e86a-ba32-4e8e-81d4-099acec9e7b1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bb8e6fc4-c8a5-446a-bd73-00970284aef2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bb8e6fc4-c8a5-446a-bd73-00970284aef2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 5104, tv_nsec: 132108930 } })
2702024-04-30T22:31:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2712024-04-30T22:31:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2722024-04-30T22:31:00.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2732024-04-30T22:31:00.250ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("070282d1-0314-4f24-9b9b-f3fe2fd417c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("73cb0d1c-76b9-46e7-a3c4-339faca846c1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fc6accb5-93bc-4f13-b90c-1fe0dce9aa08.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fc6accb5-93bc-4f13-b90c-1fe0dce9aa08.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 5104, tv_nsec: 132281894 } })
2742024-04-30T22:31:00.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2752024-04-30T22:31:00.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2762024-04-30T22:31:00.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2772024-04-30T22:31:00.251ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2782024-04-30T22:31:00.252ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
2792024-04-30T22:31:00.252ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.307358ms iteration = 11
2802024-04-30T22:31:00.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2812024-04-30T22:31:00.252ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2822024-04-30T22:31:00.252ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
2832024-04-30T22:31:00.252ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.093568ms iteration = 11
2842024-04-30T22:31:00.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2852024-04-30T22:31:00.253ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 5104, tv_nsec: 135682280 } })
2862024-04-30T22:31:00.254ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 5104, tv_nsec: 135860395 } })
2872024-04-30T22:31:00.254ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1003
2882024-04-30T22:31:00.254ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1003
2892024-04-30T22:31:00.255ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:92
2902024-04-30T22:31:00.255ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.010392ms iteration = 18
2912024-04-30T22:31:00.256ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2922024-04-30T22:31:00.256ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2932024-04-30T22:31:00.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2942024-04-30T22:31:00.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2952024-04-30T22:31:00.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2962024-04-30T22:31:00.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2972024-04-30T22:31:00.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2982024-04-30T22:31:00.258ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2992024-04-30T22:31:00.258ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3002024-04-30T22:31:00.258ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3012024-04-30T22:31:00.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3022024-04-30T22:31:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3032024-04-30T22:31:00.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3042024-04-30T22:31:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3052024-04-30T22:31:00.258ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3062024-04-30T22:31:00.258ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3072024-04-30T22:31:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3082024-04-30T22:31:00.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3092024-04-30T22:31:00.259ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 5104, tv_nsec: 141095627 } })
3102024-04-30T22:31:00.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3112024-04-30T22:31:00.260ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3122024-04-30T22:31:00.260ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1003 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9
3132024-04-30T22:31:00.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
3142024-04-30T22:31:00.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3152024-04-30T22:31:00.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3162024-04-30T22:31:00.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3172024-04-30T22:31:00.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3182024-04-30T22:31:00.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3192024-04-30T22:31:00.261ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3202024-04-30T22:31:00.261ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3212024-04-30T22:31:00.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3222024-04-30T22:31:00.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3232024-04-30T22:31:00.262ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3242024-04-30T22:31:00.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3252024-04-30T22:31:00.263ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/physical_disk_adoption.rs:100
3262024-04-30T22:31:00.263ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3272024-04-30T22:31:00.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3282024-04-30T22:31:00.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3292024-04-30T22:31:00.264ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3302024-04-30T22:31:00.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3312024-04-30T22:31:00.265ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3322024-04-30T22:31:00.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3332024-04-30T22:31:00.265ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3342024-04-30T22:31:00.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3352024-04-30T22:31:00.266ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3362024-04-30T22:31:00.266ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = e3adace0-9fc4-4aae-b613-41c0fa4ed5d0 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3372024-04-30T22:31:00.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3382024-04-30T22:31:00.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3392024-04-30T22:31:00.267ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3402024-04-30T22:31:00.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3412024-04-30T22:31:00.267ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3422024-04-30T22:31:00.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3432024-04-30T22:31:00.268ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3442024-04-30T22:31:00.268ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3452024-04-30T22:31:00.268ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3462024-04-30T22:31:00.268ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3472024-04-30T22:31:00.268ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3482024-04-30T22:31:00.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3492024-04-30T22:31:00.268ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3502024-04-30T22:31:00.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3512024-04-30T22:31:00.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3522024-04-30T22:31:00.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d44818d7-9574-4d1c-b279-50b469bf5d65, lookup_type: ById(d44818d7-9574-4d1c-b279-50b469bf5d65) } result = Ok(())
3532024-04-30T22:31:00.269ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3542024-04-30T22:31:00.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3552024-04-30T22:31:00.270ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3562024-04-30T22:31:00.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3572024-04-30T22:31:00.271ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3582024-04-30T22:31:00.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3592024-04-30T22:31:00.272ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/physical_disk_adoption.rs:174
3602024-04-30T22:31:00.272ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 22.540898ms iteration = 21
3612024-04-30T22:31:00.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3622024-04-30T22:31:00.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3632024-04-30T22:31:00.273ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3642024-04-30T22:31:00.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3652024-04-30T22:31:00.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3662024-04-30T22:31:00.273ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 original_time_created = 2024-04-30 22:22:49.833425 UTC target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 time_created = 2024-04-30 22:22:49.833425 UTC
3672024-04-30T22:31:00.273ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.113619ms iteration = 50
3682024-04-30T22:31:00.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3692024-04-30T22:31:00.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3702024-04-30T22:31:00.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3712024-04-30T22:31:00.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3722024-04-30T22:31:00.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3732024-04-30T22:31:00.275ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = e3adace0-9fc4-4aae-b613-41c0fa4ed5d0 dns_zone_name = control-plane.oxide.internal found_so_far = 49 version = 1
3742024-04-30T22:31:00.275ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3752024-04-30T22:31:00.275ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-04-30 22:23:05.301572 UTC dns_group = internal generation = 1
3762024-04-30T22:31:00.275ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 26.776016ms iteration = 11
3772024-04-30T22:31:00.276ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3782024-04-30T22:31:00.276ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3792024-04-30T22:31:00.276ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = cf8451ec-3b7b-4d93-b49a-92af124e7ecb dns_zone_name = oxide.test found_so_far = 0 version = 2
3802024-04-30T22:31:00.276ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3812024-04-30T22:31:00.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3822024-04-30T22:31:00.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3832024-04-30T22:31:00.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a52263-53ab-4221-9c03-9637ab9d1295, lookup_type: ById(03a52263-53ab-4221-9c03-9637ab9d1295) } result = Ok(())
3842024-04-30T22:31:00.280ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3852024-04-30T22:31:00.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3862024-04-30T22:31:00.281ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 31.389912ms iteration = 18
3872024-04-30T22:31:00.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3882024-04-30T22:31:00.281ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3892024-04-30T22:31:00.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3902024-04-30T22:31:00.283ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = cf8451ec-3b7b-4d93-b49a-92af124e7ecb dns_zone_name = oxide.test found_so_far = 1 version = 2
3912024-04-30T22:31:00.283ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3922024-04-30T22:31:00.283ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-04-30 22:23:05.908157 UTC dns_group = external generation = 2
3932024-04-30T22:31:00.283ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 33.376292ms iteration = 11
3942024-04-30T22:31:00.285ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-04-30T22:23:00.103859Z, time_modified: 2024-04-30T22:23:00.103859Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: cf41c5e8-dd76-445f-baa7-2d8623d33b52, db_silo: Silo { identity: SiloIdentity { id: cf41c5e8-dd76-445f-baa7-2d8623d33b52, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-04-30T22:23:05.878156Z, time_modified: 2024-04-30T22:23:05.878156Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "bae22cfecac81057c64487dfedba0fe24e127e5771e7baa73265ba34f8967916" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: cf41c5e8-dd76-445f-baa7-2d8623d33b52, db_silo: Silo { identity: SiloIdentity { id: cf41c5e8-dd76-445f-baa7-2d8623d33b52, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-04-30T22:23:05.878156Z, time_modified: 2024-04-30T22:23:05.878156Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "bae22cfecac81057c64487dfedba0fe24e127e5771e7baa73265ba34f8967916" }] }) }
3952024-04-30T22:31:00.285ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 36.05043ms iteration = 11
3962024-04-30T22:31:00.385ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
3972024-04-30T22:31:00.404ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1011 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 zone_address = fd00:1122:3344:101::2
3982024-04-30T22:31:00.404ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3992024-04-30T22:31:00.405ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "374ad00e-0def-4a82-8435-3880d48dfb00", "content-length": "26", "date": "Tue, 30 Apr 2024 22:30:59 GMT"} })
4002024-04-30T22:31:00.405ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1016 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4012024-04-30T22:31:00.406ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1048 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9
4022024-04-30T22:31:00.416ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1011 zone_address = fd00:1122:3344:101::2
4032024-04-30T22:31:00.416ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4042024-04-30T22:31:00.417ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5ab078dc-8963-469e-968a-ad72add8611f", "content-length": "26", "date": "Tue, 30 Apr 2024 22:30:59 GMT"} })
4052024-04-30T22:31:00.417ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1016 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4062024-04-30T22:31:00.418ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1048 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4072024-04-30T22:31:00.531ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
4082024-04-30T22:31:00.531ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bb972c48-97f0-4836-8cc9-6b01c7a0d052", "date": "Tue, 30 Apr 2024 22:31:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4092024-04-30T22:31:00.531ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4102024-04-30T22:31:00.533ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "079b39a0-fb5d-4304-bbbf-15d632fc306d", "date": "Tue, 30 Apr 2024 22:30:59 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4112024-04-30T22:31:00.533ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4122024-04-30T22:31:00.534ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4132024-04-30T22:31:00.534ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 285.067632ms iteration = 12
4142024-04-30T22:31:00.542ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
4152024-04-30T22:31:00.547ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1011 zone_address = fd00:1122:3344:101::2
4162024-04-30T22:31:00.547ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4172024-04-30T22:31:00.547ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9c531c5d-f80f-452a-a791-6afbcef77db9", "content-length": "26", "date": "Tue, 30 Apr 2024 22:30:59 GMT"} })
4182024-04-30T22:31:00.547ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1016 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4192024-04-30T22:31:00.549ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1048 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4202024-04-30T22:31:00.557ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 307.853836ms iteration = 18
4212024-04-30T22:31:00.712ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4222024-04-30T22:31:00.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4232024-04-30T22:31:00.714ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:141 port = SwitchPort { id: c0fb5468-b775-440a-b7cd-a2f94bb7a497, rack_id: cbc2e9a2-a4c8-47b8-a5d7-5151055087a9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(43426b1c-50e4-4799-808f-f59c4802b264) } rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 switch_location = Switch0
4242024-04-30T22:31:00.714ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4252024-04-30T22:31:00.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4262024-04-30T22:31:00.720ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4272024-04-30T22:31:00.720ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "48a1026b-2186-4b8e-b87d-835517957a94", "content-length": "2", "date": "Tue, 30 Apr 2024 22:31:00 GMT"} })
4282024-04-30T22:31:00.722ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4292024-04-30T22:31:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4302024-04-30T22:31:00.723ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 474.156462ms iteration = 18
4312024-04-30T22:31:00.724ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4322024-04-30T22:31:00.725ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8a470ea9-f899-44da-bf1a-f1ab77dbf116", "content-length": "121", "date": "Tue, 30 Apr 2024 22:31:00 GMT"} })
4332024-04-30T22:31:00.725ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:1418 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
4342024-04-30T22:31:00.725ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:1445 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 43426b1c-50e4-4799-808f-f59c4802b264
4352024-04-30T22:31:00.725ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:364 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 })}}
4362024-04-30T22:31:00.725ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:368 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 })}}
4372024-04-30T22:31:00.725ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:377 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 routes = {}
4382024-04-30T22:31:00.725ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:383 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 routes = {}
4392024-04-30T22:31:00.725ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:403 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9
4402024-04-30T22:31:00.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4412024-04-30T22:31:00.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4422024-04-30T22:31:00.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
4432024-04-30T22:31:00.727ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4442024-04-30T22:31:00.727ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "abd20156-7d8f-4efe-9b30-5ebf7af29333", "content-length": "2", "date": "Tue, 30 Apr 2024 22:31:00 GMT"} })
4452024-04-30T22:31:00.727ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4462024-04-30T22:31:00.727ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2e287964-82e1-4268-92fe-a826b72b08b9", "content-length": "52", "date": "Tue, 30 Apr 2024 22:31:00 GMT"} })
4472024-04-30T22:31:00.727ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [V4(Ipv4Network { addr: 10.151.2.174, prefix: 24 })], port: "qsfp0" }] file = nexus/src/app/background/sync_switch_configuration.rs:452 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 switch_location = Switch0
4482024-04-30T22:31:00.727ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4492024-04-30T22:31:00.757ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4502024-04-30T22:31:00.757ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "13f4b48a-e533-4d4e-b485-95963f79ebca", "date": "Tue, 30 Apr 2024 22:31:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4512024-04-30T22:31:00.757ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4522024-04-30T22:31:00.759ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1ed2e968-b402-45ec-94e8-ac1b29078651", "date": "Tue, 30 Apr 2024 22:31:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4532024-04-30T22:31:00.759ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4542024-04-30T22:31:00.761ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7b132d79-f334-40d9-b9f6-5964423c5560", "date": "Tue, 30 Apr 2024 22:31:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4552024-04-30T22:31:00.761ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4562024-04-30T22:31:00.763ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4572024-04-30T22:31:00.763ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 513.595067ms iteration = 12
4582024-04-30T22:31:00.775ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5287719c-6605-40e6-8a7c-ed9f2d0d37b3", "date": "Tue, 30 Apr 2024 22:31:00 GMT"} })
4592024-04-30T22:31:00.775ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:617 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 switch = Switch0
4602024-04-30T22:31:00.775ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4612024-04-30T22:31:00.776ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c4a85d6b-e68c-469c-a2d9-ddbf4a8f64fe", "content-length": "452", "date": "Tue, 30 Apr 2024 22:31:00 GMT"} })
4622024-04-30T22:31:00.776ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4632024-04-30T22:31:00.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4642024-04-30T22:31:00.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4652024-04-30T22:31:00.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4662024-04-30T22:31:00.781ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4672024-04-30T22:31:00.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4682024-04-30T22:31:00.783ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4692024-04-30T22:31:00.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4702024-04-30T22:31:00.790ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 540.500216ms iteration = 18
4712024-04-30T22:31:06.849ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 669 local_addr = [fd00:1122:3344:101::c]:50486 method = GET remote_addr = [fd00:1122:3344:101::d]:53271 req_id = 2f51aed8-3792-4494-98b9-9a8ed570e5ca response_code = 200 uri = //420a9926-428f-4a96-ac2a-14aba90f476b
4722024-04-30T22:31:10.249ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
4732024-04-30T22:31:10.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4742024-04-30T22:31:10.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4752024-04-30T22:31:10.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4762024-04-30T22:31:10.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4772024-04-30T22:31:10.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4782024-04-30T22:31:10.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4792024-04-30T22:31:10.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4802024-04-30T22:31:10.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4812024-04-30T22:31:10.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4822024-04-30T22:31:10.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d44818d7-9574-4d1c-b279-50b469bf5d65, lookup_type: ById(d44818d7-9574-4d1c-b279-50b469bf5d65) } result = Ok(())
4832024-04-30T22:31:10.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4842024-04-30T22:31:10.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4852024-04-30T22:31:10.266ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 original_time_created = 2024-04-30 22:22:49.833425 UTC target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 time_created = 2024-04-30 22:22:49.833425 UTC
4862024-04-30T22:31:10.266ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.64784ms iteration = 51
4872024-04-30T22:31:16.849ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 582 local_addr = [fd00:1122:3344:101::c]:50486 method = GET remote_addr = [fd00:1122:3344:101::d]:53271 req_id = 6daffda1-a27f-4712-81ba-fe7e02242c1b response_code = 200 uri = //420a9926-428f-4a96-ac2a-14aba90f476b
4882024-04-30T22:31:20.249ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
4892024-04-30T22:31:20.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4902024-04-30T22:31:20.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4912024-04-30T22:31:20.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4922024-04-30T22:31:20.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4932024-04-30T22:31:20.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4942024-04-30T22:31:20.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4952024-04-30T22:31:20.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4962024-04-30T22:31:20.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4972024-04-30T22:31:20.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4982024-04-30T22:31:20.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d44818d7-9574-4d1c-b279-50b469bf5d65, lookup_type: ById(d44818d7-9574-4d1c-b279-50b469bf5d65) } result = Ok(())
4992024-04-30T22:31:20.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5002024-04-30T22:31:20.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5012024-04-30T22:31:20.266ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 original_time_created = 2024-04-30 22:22:49.833425 UTC target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 time_created = 2024-04-30 22:22:49.833425 UTC
5022024-04-30T22:31:20.266ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.183424ms iteration = 52
5032024-04-30T22:31:26.849ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 817 local_addr = [fd00:1122:3344:101::c]:50486 method = GET remote_addr = [fd00:1122:3344:101::d]:53271 req_id = 3075c7f2-1a73-4acc-9416-bf8334e68747 response_code = 200 uri = //420a9926-428f-4a96-ac2a-14aba90f476b
5042024-04-30T22:31:30.249ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
5052024-04-30T22:31:30.249ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
5062024-04-30T22:31:30.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5072024-04-30T22:31:30.249ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
5082024-04-30T22:31:30.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5092024-04-30T22:31:30.249ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5102024-04-30T22:31:30.249ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
5112024-04-30T22:31:30.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5122024-04-30T22:31:30.250ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
5132024-04-30T22:31:30.250ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:46
5142024-04-30T22:31:30.250ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
5152024-04-30T22:31:30.250ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/region_replacement.rs:44
5162024-04-30T22:31:30.250ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/region_replacement.rs:48
5172024-04-30T22:31:30.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 9.69\u{b5}s iteration = 19
5182024-04-30T22:31:30.250ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
5192024-04-30T22:31:30.250ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
5202024-04-30T22:31:30.250ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
5212024-04-30T22:31:30.250ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5222024-04-30T22:31:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5232024-04-30T22:31:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5242024-04-30T22:31:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5252024-04-30T22:31:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5262024-04-30T22:31:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5272024-04-30T22:31:30.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5282024-04-30T22:31:30.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5292024-04-30T22:31:30.252ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5302024-04-30T22:31:30.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5312024-04-30T22:31:30.252ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 5134, tv_nsec: 134564372 } })
5322024-04-30T22:31:30.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5332024-04-30T22:31:30.252ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1003
5342024-04-30T22:31:30.253ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 5134, tv_nsec: 135770163 } })
5352024-04-30T22:31:30.253ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/phantom_disks.rs:92
5362024-04-30T22:31:30.253ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.926619ms iteration = 19
5372024-04-30T22:31:30.254ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1003
5382024-04-30T22:31:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5392024-04-30T22:31:30.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5402024-04-30T22:31:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5412024-04-30T22:31:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5422024-04-30T22:31:30.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5432024-04-30T22:31:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5442024-04-30T22:31:30.256ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5452024-04-30T22:31:30.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5462024-04-30T22:31:30.256ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5472024-04-30T22:31:30.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5482024-04-30T22:31:30.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5492024-04-30T22:31:30.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5502024-04-30T22:31:30.257ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5512024-04-30T22:31:30.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5522024-04-30T22:31:30.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5532024-04-30T22:31:30.258ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03a52263-53ab-4221-9c03-9637ab9d1295.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 5134, tv_nsec: 140474611 } })
5542024-04-30T22:31:30.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5552024-04-30T22:31:30.258ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/physical_disk_adoption.rs:100
5562024-04-30T22:31:30.258ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5572024-04-30T22:31:30.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5582024-04-30T22:31:30.259ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1003 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9
5592024-04-30T22:31:30.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5602024-04-30T22:31:30.260ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5612024-04-30T22:31:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5622024-04-30T22:31:30.262ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5632024-04-30T22:31:30.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5642024-04-30T22:31:30.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d44818d7-9574-4d1c-b279-50b469bf5d65, lookup_type: ById(d44818d7-9574-4d1c-b279-50b469bf5d65) } result = Ok(())
5652024-04-30T22:31:30.263ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5662024-04-30T22:31:30.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5672024-04-30T22:31:30.266ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/physical_disk_adoption.rs:174
5682024-04-30T22:31:30.266ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 16.169187ms iteration = 22
5692024-04-30T22:31:30.267ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 original_time_created = 2024-04-30 22:22:49.833425 UTC target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 time_created = 2024-04-30 22:22:49.833425 UTC
5702024-04-30T22:31:30.267ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.901352ms iteration = 53
5712024-04-30T22:31:30.269ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5722024-04-30T22:31:30.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5732024-04-30T22:31:30.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5742024-04-30T22:31:30.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5752024-04-30T22:31:30.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5762024-04-30T22:31:30.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03a52263-53ab-4221-9c03-9637ab9d1295, lookup_type: ById(03a52263-53ab-4221-9c03-9637ab9d1295) } result = Ok(())
5772024-04-30T22:31:30.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5782024-04-30T22:31:30.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5792024-04-30T22:31:30.274ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 24.884708ms iteration = 19
5802024-04-30T22:31:30.323ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1011 zone_address = fd00:1122:3344:101::2
5812024-04-30T22:31:30.324ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5822024-04-30T22:31:30.324ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1011 zone_address = fd00:1122:3344:101::2
5832024-04-30T22:31:30.324ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5842024-04-30T22:31:30.324ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "07fb64fb-d20e-437f-9e65-3e2c41ceb364", "content-length": "26", "date": "Tue, 30 Apr 2024 22:31:30 GMT"} })
5852024-04-30T22:31:30.324ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1016 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5862024-04-30T22:31:30.324ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "69bebd2a-8e5a-47fe-af3a-6739c9930d74", "content-length": "26", "date": "Tue, 30 Apr 2024 22:31:29 GMT"} })
5872024-04-30T22:31:30.324ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1016 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5882024-04-30T22:31:30.326ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1048 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5892024-04-30T22:31:30.327ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1048 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5902024-04-30T22:31:30.341ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1011 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 zone_address = fd00:1122:3344:101::2
5912024-04-30T22:31:30.341ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5922024-04-30T22:31:30.342ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f423a4e7-84a1-44d3-8cad-a838b593bdea", "content-length": "26", "date": "Tue, 30 Apr 2024 22:31:30 GMT"} })
5932024-04-30T22:31:30.342ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1016 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5942024-04-30T22:31:30.343ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1048 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9
5952024-04-30T22:31:30.403ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
5962024-04-30T22:31:30.403ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "13d6857c-2dfa-4c8a-8c1a-295de77b6ae8", "content-length": "2", "date": "Tue, 30 Apr 2024 22:31:29 GMT"} })
5972024-04-30T22:31:30.405ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5982024-04-30T22:31:30.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5992024-04-30T22:31:30.407ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 157.470473ms iteration = 19
6002024-04-30T22:31:30.409ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 159.512805ms iteration = 19
6012024-04-30T22:31:30.469ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6022024-04-30T22:31:30.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6032024-04-30T22:31:30.471ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:141 port = SwitchPort { id: c0fb5468-b775-440a-b7cd-a2f94bb7a497, rack_id: cbc2e9a2-a4c8-47b8-a5d7-5151055087a9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(43426b1c-50e4-4799-808f-f59c4802b264) } rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 switch_location = Switch0
6042024-04-30T22:31:30.471ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6052024-04-30T22:31:30.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6062024-04-30T22:31:30.478ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
6072024-04-30T22:31:30.478ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7915c08a-78d4-40a9-b7d3-b21aa2204b37", "content-length": "121", "date": "Tue, 30 Apr 2024 22:31:29 GMT"} })
6082024-04-30T22:31:30.478ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:1418 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
6092024-04-30T22:31:30.478ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:1445 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 43426b1c-50e4-4799-808f-f59c4802b264
6102024-04-30T22:31:30.478ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:364 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 })}}
6112024-04-30T22:31:30.478ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:368 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 })}}
6122024-04-30T22:31:30.478ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:377 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 routes = {}
6132024-04-30T22:31:30.478ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:383 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 routes = {}
6142024-04-30T22:31:30.478ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:403 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9
6152024-04-30T22:31:30.478ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6162024-04-30T22:31:30.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6172024-04-30T22:31:30.480ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
6182024-04-30T22:31:30.481ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "71149799-2bc2-4a62-a461-cf2fa1e6b734", "content-length": "2", "date": "Tue, 30 Apr 2024 22:31:29 GMT"} })
6192024-04-30T22:31:30.481ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
6202024-04-30T22:31:30.481ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c72a57fe-6663-4d77-a9cf-eed400311e8b", "content-length": "52", "date": "Tue, 30 Apr 2024 22:31:29 GMT"} })
6212024-04-30T22:31:30.481ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [V4(Ipv4Network { addr: 10.151.2.174, prefix: 24 })], port: "qsfp0" }] file = nexus/src/app/background/sync_switch_configuration.rs:452 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 switch_location = Switch0
6222024-04-30T22:31:30.481ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
6232024-04-30T22:31:30.530ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b40eafa8-32fa-4843-9bde-e4b987f5cb5a", "date": "Tue, 30 Apr 2024 22:31:30 GMT"} })
6242024-04-30T22:31:30.530ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/sync_switch_configuration.rs:617 rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 switch = Switch0
6252024-04-30T22:31:30.530ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
6262024-04-30T22:31:30.530ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cbc2e9a2-a4c8-47b8-a5d7-5151055087a9 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6566c56f-8e36-42ca-b270-3b9f9698c5c7", "content-length": "452", "date": "Tue, 30 Apr 2024 22:31:30 GMT"} })
6272024-04-30T22:31:30.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6282024-04-30T22:31:30.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6292024-04-30T22:31:30.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6302024-04-30T22:31:30.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6312024-04-30T22:31:30.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6322024-04-30T22:31:30.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6332024-04-30T22:31:30.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6342024-04-30T22:31:30.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6352024-04-30T22:31:30.544ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 294.782587ms iteration = 19
6362024-04-30T22:31:36.849ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 453 local_addr = [fd00:1122:3344:101::c]:50486 method = GET remote_addr = [fd00:1122:3344:101::d]:53271 req_id = 6ad2021b-f2d7-4359-b0f5-41babebc9931 response_code = 200 uri = //420a9926-428f-4a96-ac2a-14aba90f476b
6372024-04-30T22:31:40.249ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
6382024-04-30T22:31:40.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6392024-04-30T22:31:40.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6402024-04-30T22:31:40.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6412024-04-30T22:31:40.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6422024-04-30T22:31:40.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6432024-04-30T22:31:40.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6442024-04-30T22:31:40.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6452024-04-30T22:31:40.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6462024-04-30T22:31:40.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6472024-04-30T22:31:40.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d44818d7-9574-4d1c-b279-50b469bf5d65, lookup_type: ById(d44818d7-9574-4d1c-b279-50b469bf5d65) } result = Ok(())
6482024-04-30T22:31:40.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6492024-04-30T22:31:40.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6502024-04-30T22:31:40.266ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 original_time_created = 2024-04-30 22:22:49.833425 UTC target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 time_created = 2024-04-30 22:22:49.833425 UTC
6512024-04-30T22:31:40.266ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.876835ms iteration = 54
6522024-04-30T22:31:46.848ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/29ae98d/dropshot/src/server.rs:849 latency_us = 779 local_addr = [fd00:1122:3344:101::c]:50486 method = GET remote_addr = [fd00:1122:3344:101::d]:53271 req_id = 795de212-d177-4a8c-a157-acab39d63dd1 response_code = 200 uri = //420a9926-428f-4a96-ac2a-14aba90f476b
6532024-04-30T22:31:50.250ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
6542024-04-30T22:31:50.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6552024-04-30T22:31:50.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6562024-04-30T22:31:50.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6572024-04-30T22:31:50.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6582024-04-30T22:31:50.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6592024-04-30T22:31:50.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6602024-04-30T22:31:50.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6612024-04-30T22:31:50.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6622024-04-30T22:31:50.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6632024-04-30T22:31:50.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d44818d7-9574-4d1c-b279-50b469bf5d65, lookup_type: ById(d44818d7-9574-4d1c-b279-50b469bf5d65) } result = Ok(())
6642024-04-30T22:31:50.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6652024-04-30T22:31:50.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6662024-04-30T22:31:50.267ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 original_time_created = 2024-04-30 22:22:49.833425 UTC target_id = d44818d7-9574-4d1c-b279-50b469bf5d65 time_created = 2024-04-30 22:22:49.833425 UTC
6672024-04-30T22:31:50.267ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.361518ms iteration = 55