Max level shown:
12024-12-21T07:45:00.678ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1034, tv_nsec: 379723530 } })
22024-12-21T07:45:00.679ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
32024-12-21T07:45:00.679ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1034, tv_nsec: 380419871 } })
42024-12-21T07:45:00.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52024-12-21T07:45:00.680ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
62024-12-21T07:45:00.681ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72024-12-21T07:45:00.681ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82024-12-21T07:45:00.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92024-12-21T07:45:00.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102024-12-21T07:45:00.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112024-12-21T07:45:00.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122024-12-21T07:45:00.685ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:35:00.664957203 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
132024-12-21T07:45:00.685ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 20.579382ms iteration = 3 status = {"expiration":"2024-12-21T07:35:00.664957203Z","pruned":[]}
142024-12-21T07:45:00.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 21.900974ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
152024-12-21T07:45:00.688ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
162024-12-21T07:45:00.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
172024-12-21T07:45:00.690ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
182024-12-21T07:45:00.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
192024-12-21T07:45:00.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
202024-12-21T07:45:00.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1034, tv_nsec: 392505103 } })
212024-12-21T07:45:00.691ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
222024-12-21T07:45:00.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
232024-12-21T07:45:00.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
242024-12-21T07:45:00.692ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
252024-12-21T07:45:00.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
262024-12-21T07:45:00.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
272024-12-21T07:45:00.697ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
282024-12-21T07:45:00.697ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
292024-12-21T07:45:00.697ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
302024-12-21T07:45:00.697ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
312024-12-21T07:45:00.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
322024-12-21T07:45:00.698ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
332024-12-21T07:45:00.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
342024-12-21T07:45:00.700ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
352024-12-21T07:45:00.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
362024-12-21T07:45:00.701ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
372024-12-21T07:45:00.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
382024-12-21T07:45:00.705ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
392024-12-21T07:45:00.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
402024-12-21T07:45:00.706ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
412024-12-21T07:45:00.707ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 42.794342ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
422024-12-21T07:45:00.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
432024-12-21T07:45:00.711ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
442024-12-21T07:45:00.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
452024-12-21T07:45:00.716ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
462024-12-21T07:45:00.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
472024-12-21T07:45:00.719ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
482024-12-21T07:45:00.722ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
492024-12-21T07:45:00.722ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
502024-12-21T07:45:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
512024-12-21T07:45:00.730ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
522024-12-21T07:45:00.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
532024-12-21T07:45:00.731ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:42:50.264108Z, time_modified: 2024-12-21T07:42:50.264108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
542024-12-21T07:45:00.731ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 66.396545ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]}},"default_endpoint":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
552024-12-21T07:45:00.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
562024-12-21T07:45:00.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
572024-12-21T07:45:00.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
582024-12-21T07:45:00.734ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
592024-12-21T07:45:00.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
602024-12-21T07:45:00.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
612024-12-21T07:45:00.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
622024-12-21T07:45:00.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
632024-12-21T07:45:00.740ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
642024-12-21T07:45:00.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
652024-12-21T07:45:00.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
662024-12-21T07:45:00.742ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
672024-12-21T07:45:00.742ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
682024-12-21T07:45:00.742ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
692024-12-21T07:45:00.742ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 77.053162ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
702024-12-21T07:45:00.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
712024-12-21T07:45:00.742ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
722024-12-21T07:45:00.742ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
732024-12-21T07:45:00.742ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 78.037198ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
742024-12-21T07:45:00.744ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
752024-12-21T07:45:00.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
762024-12-21T07:45:00.744ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
772024-12-21T07:45:00.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
782024-12-21T07:45:00.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
792024-12-21T07:45:00.746ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
802024-12-21T07:45:00.746ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
812024-12-21T07:45:00.746ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
822024-12-21T07:45:00.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
832024-12-21T07:45:00.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
842024-12-21T07:45:00.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
852024-12-21T07:45:00.747ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
862024-12-21T07:45:00.747ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.39768ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
872024-12-21T07:45:00.749ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 84.480616ms iteration = 5 status = 0
882024-12-21T07:45:00.749ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
892024-12-21T07:45:00.749ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
902024-12-21T07:45:00.749ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
912024-12-21T07:45:00.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
922024-12-21T07:45:00.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
932024-12-21T07:45:00.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
942024-12-21T07:45:00.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
952024-12-21T07:45:00.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
962024-12-21T07:45:00.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
972024-12-21T07:45:00.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
982024-12-21T07:45:00.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
992024-12-21T07:45:00.752ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1002024-12-21T07:45:00.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1012024-12-21T07:45:00.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1022024-12-21T07:45:00.753ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1032024-12-21T07:45:00.755ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1042024-12-21T07:45:00.755ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1052024-12-21T07:45:00.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1062024-12-21T07:45:00.769ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1072024-12-21T07:45:00.769ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 104.746592ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1082024-12-21T07:45:00.772ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1092024-12-21T07:45:00.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1102024-12-21T07:45:00.778ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
1112024-12-21T07:45:00.778ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 112.98587ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
1122024-12-21T07:45:00.787ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 122.788653ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1132024-12-21T07:45:00.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1142024-12-21T07:45:00.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 131.205433ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1152024-12-21T07:45:00.796ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1162024-12-21T07:45:00.796ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1172024-12-21T07:45:00.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1182024-12-21T07:45:00.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1192024-12-21T07:45:00.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
1202024-12-21T07:45:00.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1212024-12-21T07:45:00.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1222024-12-21T07:45:00.801ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
1232024-12-21T07:45:00.801ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
1242024-12-21T07:45:00.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1252024-12-21T07:45:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1262024-12-21T07:45:00.804ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1272024-12-21T07:45:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
1282024-12-21T07:45:00.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1292024-12-21T07:45:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1302024-12-21T07:45:00.812ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
1312024-12-21T07:45:00.826ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
1322024-12-21T07:45:00.826ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
1332024-12-21T07:45:00.826ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:43:39.444085 UTC dns_group = internal generation = 1
1342024-12-21T07:45:00.826ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 161.537637ms iteration = 4 status = {"generation":1}
1352024-12-21T07:45:00.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1362024-12-21T07:45:00.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1372024-12-21T07:45:00.852ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1382024-12-21T07:45:00.852ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
1392024-12-21T07:45:00.852ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 187.743904ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
1402024-12-21T07:45:00.855ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
1412024-12-21T07:45:00.856ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1422024-12-21T07:45:00.856ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "435e53e2-c113-434e-a58d-2423139a9890", "content-length": "26", "date": "Sat, 21 Dec 2024 07:45:00 GMT"} })
1432024-12-21T07:45:00.856ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1442024-12-21T07:45:00.858ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
1452024-12-21T07:45:00.858ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 0 version = 2
1462024-12-21T07:45:00.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1472024-12-21T07:45:00.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1482024-12-21T07:45:00.858ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1492024-12-21T07:45:00.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1502024-12-21T07:45:00.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
1512024-12-21T07:45:00.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1522024-12-21T07:45:00.870ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 205.51316ms iteration = 8 status = {"physical_disks_added":0}
1532024-12-21T07:45:00.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1542024-12-21T07:45:00.873ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 1 version = 2
1552024-12-21T07:45:00.873ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
1562024-12-21T07:45:00.873ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:43:41.075205 UTC dns_group = external generation = 2
1572024-12-21T07:45:00.873ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 208.827584ms iteration = 4 status = {"generation":2}
1582024-12-21T07:45:00.879ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
1592024-12-21T07:45:00.879ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1602024-12-21T07:45:00.880ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0630ee1c-c1c1-4b16-b26d-f3873011fd11", "content-length": "26", "date": "Sat, 21 Dec 2024 07:45:00 GMT"} })
1612024-12-21T07:45:00.880ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1622024-12-21T07:45:00.882ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
1632024-12-21T07:45:00.937ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
1642024-12-21T07:45:00.940ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
1652024-12-21T07:45:00.940ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 275.904331ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
1662024-12-21T07:45:00.981ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
1672024-12-21T07:45:00.981ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5da5b35f-5bc8-43fe-9101-5b970179457f", "date": "Sat, 21 Dec 2024 07:45:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
1682024-12-21T07:45:00.981ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
1692024-12-21T07:45:00.983ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b1912513-028c-41d5-8a7e-b3117a141ad4", "date": "Sat, 21 Dec 2024 07:45:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
1702024-12-21T07:45:00.983ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
1712024-12-21T07:45:00.985ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
1722024-12-21T07:45:00.985ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 321.138323ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
1732024-12-21T07:45:01.005ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1742024-12-21T07:45:01.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1752024-12-21T07:45:01.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1762024-12-21T07:45:01.010ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1772024-12-21T07:45:01.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1782024-12-21T07:45:01.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1792024-12-21T07:45:01.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1802024-12-21T07:45:01.015ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
1812024-12-21T07:45:01.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1822024-12-21T07:45:01.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1832024-12-21T07:45:01.018ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
1842024-12-21T07:45:01.018ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1852024-12-21T07:45:01.018ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "843fb14e-cf42-4342-9d0a-99510682a078", "content-length": "26", "date": "Sat, 21 Dec 2024 07:45:00 GMT"} })
1862024-12-21T07:45:01.018ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1872024-12-21T07:45:01.020ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1882024-12-21T07:45:01.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f803428d-322a-47ca-b1bc-f26a61c2e193 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
1892024-12-21T07:45:01.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f803428d-322a-47ca-b1bc-f26a61c2e193 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
1902024-12-21T07:45:01.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f803428d-322a-47ca-b1bc-f26a61c2e193 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
1912024-12-21T07:45:01.144ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
1922024-12-21T07:45:01.159ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 494.899945ms iteration = 5 status = {}
1932024-12-21T07:45:01.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 1646cac5-5759-4f58-8eb6-26f08aa0a9c9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
1942024-12-21T07:45:01.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 1646cac5-5759-4f58-8eb6-26f08aa0a9c9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
1952024-12-21T07:45:01.178ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
1962024-12-21T07:45:01.178ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1972024-12-21T07:45:01.178ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "64f40970-1c99-4373-9f3f-2ea2120978ad", "content-length": "372", "date": "Sat, 21 Dec 2024 07:45:01 GMT"} })
1982024-12-21T07:45:01.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1992024-12-21T07:45:01.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2002024-12-21T07:45:01.185ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2012024-12-21T07:45:01.186ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "760f4254-a051-4835-8359-4673b9978767", "content-length": "691", "date": "Sat, 21 Dec 2024 07:45:01 GMT"} })
2022024-12-21T07:45:01.186ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
2032024-12-21T07:45:01.186ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
2042024-12-21T07:45:01.186ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
2052024-12-21T07:45:01.188ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 523.798966ms iteration = 5 status = {}
2062024-12-21T07:45:01.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 1646cac5-5759-4f58-8eb6-26f08aa0a9c9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
2072024-12-21T07:45:01.208ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
2082024-12-21T07:45:01.208ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2092024-12-21T07:45:01.209ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6aa24a9a-edd4-4200-8bc7-3fc1533cc1c7", "date": "Sat, 21 Dec 2024 07:45:01 GMT"} })
2102024-12-21T07:45:01.209ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2112024-12-21T07:45:01.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2122024-12-21T07:45:01.212ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2132024-12-21T07:45:01.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2142024-12-21T07:45:01.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2152024-12-21T07:45:01.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2162024-12-21T07:45:01.220ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2172024-12-21T07:45:01.220ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2182024-12-21T07:45:01.220ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1aaea67b-adf9-4e98-ad44-8c82336dbad2", "date": "Sat, 21 Dec 2024 07:45:01 GMT"} })
2192024-12-21T07:45:01.222ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 557.038688ms iteration = 6 status = {}
2202024-12-21T07:45:01.247ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
2212024-12-21T07:45:01.248ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "da4cec3c-78c0-4f83-b588-424facbc4df8", "date": "Sat, 21 Dec 2024 07:45:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
2222024-12-21T07:45:01.248ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
2232024-12-21T07:45:01.250ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b4b9419e-00ce-42a7-ab9a-5a9a5440b117", "date": "Sat, 21 Dec 2024 07:45:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
2242024-12-21T07:45:01.250ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
2252024-12-21T07:45:01.251ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f16a0efd-a342-4636-84d9-483e6c34e000", "date": "Sat, 21 Dec 2024 07:45:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
2262024-12-21T07:45:01.251ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
2272024-12-21T07:45:01.252ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
2282024-12-21T07:45:01.252ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 587.674068ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
2292024-12-21T07:45:01.279ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
2302024-12-21T07:45:01.279ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c9dfa79-f9c9-4f5e-b594-788a4ecb1b04", "content-length": "1", "date": "Sat, 21 Dec 2024 07:45:01 GMT"} })
2312024-12-21T07:45:01.281ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2322024-12-21T07:45:01.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2332024-12-21T07:45:01.283ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 618.486502ms iteration = 5 status = null
2342024-12-21T07:45:01.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2352024-12-21T07:45:01.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2362024-12-21T07:45:01.324ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
2372024-12-21T07:45:01.324ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2382024-12-21T07:45:01.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2392024-12-21T07:45:01.339ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2402024-12-21T07:45:01.339ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e51f8b0a-f913-4b90-b8d1-9a73204daf0c", "content-length": "134", "date": "Sat, 21 Dec 2024 07:45:01 GMT"} })
2412024-12-21T07:45:01.339ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2422024-12-21T07:45:01.339ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
2432024-12-21T07:45:01.339ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2442024-12-21T07:45:01.339ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2452024-12-21T07:45:01.339ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2462024-12-21T07:45:01.339ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2472024-12-21T07:45:01.339ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2482024-12-21T07:45:01.339ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2492024-12-21T07:45:01.340ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2502024-12-21T07:45:01.340ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2512024-12-21T07:45:01.340ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
2522024-12-21T07:45:01.340ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2532024-12-21T07:45:01.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2542024-12-21T07:45:01.342ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2552024-12-21T07:45:01.342ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1181e1a9-dcff-4338-8c4a-833bb7b8708a", "content-length": "2", "date": "Sat, 21 Dec 2024 07:45:01 GMT"} })
2562024-12-21T07:45:01.342ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2572024-12-21T07:45:01.342ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "700776f7-7449-43e1-9d48-bcb5608607c6", "content-length": "52", "date": "Sat, 21 Dec 2024 07:45:01 GMT"} })
2582024-12-21T07:45:01.342ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
2592024-12-21T07:45:01.342ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2602024-12-21T07:45:01.519ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "35281438-eecd-40a0-8b92-0a8a3314b388", "date": "Sat, 21 Dec 2024 07:45:01 GMT"} })
2612024-12-21T07:45:01.519ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
2622024-12-21T07:45:01.519ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2632024-12-21T07:45:01.524ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "13ceac57-18c0-462d-82f2-749f0fb1e89d", "content-length": "682", "date": "Sat, 21 Dec 2024 07:45:01 GMT"} })
2642024-12-21T07:45:01.524ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2652024-12-21T07:45:01.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2662024-12-21T07:45:01.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2672024-12-21T07:45:01.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2682024-12-21T07:45:01.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2692024-12-21T07:45:01.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2702024-12-21T07:45:01.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2712024-12-21T07:45:01.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2722024-12-21T07:45:01.559ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 895.136945ms iteration = 5 status = {}
2732024-12-21T07:45:02.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 79dc0674-c5cc-4b56-8d2d-5597f8ab545e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2742024-12-21T07:45:02.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 79dc0674-c5cc-4b56-8d2d-5597f8ab545e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2752024-12-21T07:45:02.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 79dc0674-c5cc-4b56-8d2d-5597f8ab545e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2762024-12-21T07:45:03.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cfa24094-7349-44ea-aa91-c19602aa64e5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2772024-12-21T07:45:03.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cfa24094-7349-44ea-aa91-c19602aa64e5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2782024-12-21T07:45:03.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cfa24094-7349-44ea-aa91-c19602aa64e5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2792024-12-21T07:45:04.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ce9e0aee-2837-42cc-85e3-d2f0c32fe515 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2802024-12-21T07:45:04.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ce9e0aee-2837-42cc-85e3-d2f0c32fe515 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2812024-12-21T07:45:04.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ce9e0aee-2837-42cc-85e3-d2f0c32fe515 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2822024-12-21T07:45:05.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9b64f2db-f81e-4371-b046-7e5339f65881 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2832024-12-21T07:45:05.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9b64f2db-f81e-4371-b046-7e5339f65881 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2842024-12-21T07:45:05.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9b64f2db-f81e-4371-b046-7e5339f65881 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2852024-12-21T07:45:06.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d0aefb7b-02c7-4bec-ad4c-5e847d8ceecd roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2862024-12-21T07:45:06.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d0aefb7b-02c7-4bec-ad4c-5e847d8ceecd resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2872024-12-21T07:45:06.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d0aefb7b-02c7-4bec-ad4c-5e847d8ceecd response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2882024-12-21T07:45:07.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f7464ac4-95c7-4614-9206-5e1c52ffcb1c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2892024-12-21T07:45:07.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f7464ac4-95c7-4614-9206-5e1c52ffcb1c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2902024-12-21T07:45:07.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f7464ac4-95c7-4614-9206-5e1c52ffcb1c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2912024-12-21T07:45:08.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a6937142-2422-464f-8435-ef4f0a9c0a35 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2922024-12-21T07:45:08.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a6937142-2422-464f-8435-ef4f0a9c0a35 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2932024-12-21T07:45:08.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a6937142-2422-464f-8435-ef4f0a9c0a35 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2942024-12-21T07:45:09.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eb29c1e5-08cc-4493-8809-7a39034e69fd roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2952024-12-21T07:45:09.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eb29c1e5-08cc-4493-8809-7a39034e69fd resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2962024-12-21T07:45:09.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eb29c1e5-08cc-4493-8809-7a39034e69fd response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2972024-12-21T07:45:09.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1362 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 95cf3b6c-e0bd-4f31-a1d8-9665141c245e response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
2982024-12-21T07:45:10.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4d668305-0535-4efe-a03c-714bfbf32f05 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2992024-12-21T07:45:10.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4d668305-0535-4efe-a03c-714bfbf32f05 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3002024-12-21T07:45:10.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4d668305-0535-4efe-a03c-714bfbf32f05 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3012024-12-21T07:45:10.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
3022024-12-21T07:45:10.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
3032024-12-21T07:45:10.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3042024-12-21T07:45:10.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3052024-12-21T07:45:10.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3062024-12-21T07:45:10.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3072024-12-21T07:45:10.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3082024-12-21T07:45:10.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3092024-12-21T07:45:10.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3102024-12-21T07:45:10.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3112024-12-21T07:45:10.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3122024-12-21T07:45:10.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3132024-12-21T07:45:10.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3142024-12-21T07:45:10.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
3152024-12-21T07:45:10.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3162024-12-21T07:45:10.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3172024-12-21T07:45:10.686ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
3182024-12-21T07:45:10.686ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.67909ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
3192024-12-21T07:45:10.693ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3202024-12-21T07:45:10.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3212024-12-21T07:45:10.721ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.178864ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3222024-12-21T07:45:11.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = acd90e50-378a-49ba-8ad3-079c8945234e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3232024-12-21T07:45:11.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = acd90e50-378a-49ba-8ad3-079c8945234e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3242024-12-21T07:45:11.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = acd90e50-378a-49ba-8ad3-079c8945234e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3252024-12-21T07:45:12.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6af22db0-cad9-4ffa-aa87-7b35071db859 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3262024-12-21T07:45:12.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6af22db0-cad9-4ffa-aa87-7b35071db859 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3272024-12-21T07:45:12.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1749 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6af22db0-cad9-4ffa-aa87-7b35071db859 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3282024-12-21T07:45:13.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ff2da3f0-6dee-4a6c-9eba-96939c1dd787 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3292024-12-21T07:45:13.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ff2da3f0-6dee-4a6c-9eba-96939c1dd787 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3302024-12-21T07:45:13.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ff2da3f0-6dee-4a6c-9eba-96939c1dd787 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3312024-12-21T07:45:14.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 993c51a9-1e36-4749-9c6d-88fc8b0f0cb7 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3322024-12-21T07:45:14.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 993c51a9-1e36-4749-9c6d-88fc8b0f0cb7 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3332024-12-21T07:45:14.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 993c51a9-1e36-4749-9c6d-88fc8b0f0cb7 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3342024-12-21T07:45:15.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2c9c2192-11e5-4daf-83ab-b7082ffafcb2 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3352024-12-21T07:45:15.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2c9c2192-11e5-4daf-83ab-b7082ffafcb2 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3362024-12-21T07:45:15.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2c9c2192-11e5-4daf-83ab-b7082ffafcb2 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3372024-12-21T07:45:16.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 534fae7c-6e4e-499a-a2af-42363db5fd37 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3382024-12-21T07:45:16.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 534fae7c-6e4e-499a-a2af-42363db5fd37 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3392024-12-21T07:45:16.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 534fae7c-6e4e-499a-a2af-42363db5fd37 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3402024-12-21T07:45:17.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4f3cc565-822c-445f-8513-1df0f41def2b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3412024-12-21T07:45:17.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4f3cc565-822c-445f-8513-1df0f41def2b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3422024-12-21T07:45:17.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4f3cc565-822c-445f-8513-1df0f41def2b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3432024-12-21T07:45:18.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 60b8f4e8-9801-4bc8-aebf-3bda78942681 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3442024-12-21T07:45:18.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 60b8f4e8-9801-4bc8-aebf-3bda78942681 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3452024-12-21T07:45:18.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 60b8f4e8-9801-4bc8-aebf-3bda78942681 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3462024-12-21T07:45:19.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eef5206c-c765-4ae3-b19b-3cb37b41d506 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3472024-12-21T07:45:19.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eef5206c-c765-4ae3-b19b-3cb37b41d506 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3482024-12-21T07:45:19.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1646 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eef5206c-c765-4ae3-b19b-3cb37b41d506 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3492024-12-21T07:45:19.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = edb06c18-e1ff-4067-a3a2-6120db7716d9 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
3502024-12-21T07:45:19.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = edb06c18-e1ff-4067-a3a2-6120db7716d9 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
3512024-12-21T07:45:19.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = edb06c18-e1ff-4067-a3a2-6120db7716d9 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
3522024-12-21T07:45:19.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 7050f76b-e1e1-4340-a94f-7cffc64d1d00 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
3532024-12-21T07:45:19.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 7050f76b-e1e1-4340-a94f-7cffc64d1d00 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
3542024-12-21T07:45:19.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 7050f76b-e1e1-4340-a94f-7cffc64d1d00 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
3552024-12-21T07:45:19.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1280 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = f8d5ba10-83e7-41e9-a6ec-387ae148c1cc response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
3562024-12-21T07:45:20.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f24e16fd-a7c3-4f40-a047-b7c5a5b6f6b7 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3572024-12-21T07:45:20.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f24e16fd-a7c3-4f40-a047-b7c5a5b6f6b7 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3582024-12-21T07:45:20.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1749 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f24e16fd-a7c3-4f40-a047-b7c5a5b6f6b7 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3592024-12-21T07:45:20.664ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
3602024-12-21T07:45:20.664ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
3612024-12-21T07:45:20.664ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3622024-12-21T07:45:20.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3632024-12-21T07:45:20.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3642024-12-21T07:45:20.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3652024-12-21T07:45:20.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3662024-12-21T07:45:20.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3672024-12-21T07:45:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3682024-12-21T07:45:20.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.076497ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3692024-12-21T07:45:20.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3702024-12-21T07:45:20.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3712024-12-21T07:45:20.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3722024-12-21T07:45:20.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3732024-12-21T07:45:20.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3742024-12-21T07:45:20.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3752024-12-21T07:45:20.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
3762024-12-21T07:45:20.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3772024-12-21T07:45:20.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3782024-12-21T07:45:20.687ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
3792024-12-21T07:45:20.687ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.430893ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
3802024-12-21T07:45:21.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = aa43ca1f-383e-4365-9e55-18d8177a9a8c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3812024-12-21T07:45:21.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = aa43ca1f-383e-4365-9e55-18d8177a9a8c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3822024-12-21T07:45:21.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1726 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = aa43ca1f-383e-4365-9e55-18d8177a9a8c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3832024-12-21T07:45:22.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ccc9cf15-b432-4721-9583-a9c607388714 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3842024-12-21T07:45:22.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ccc9cf15-b432-4721-9583-a9c607388714 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3852024-12-21T07:45:22.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ccc9cf15-b432-4721-9583-a9c607388714 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3862024-12-21T07:45:23.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5352119d-b2fb-4d2d-982c-d2dc989a7095 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3872024-12-21T07:45:23.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5352119d-b2fb-4d2d-982c-d2dc989a7095 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3882024-12-21T07:45:23.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2697 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5352119d-b2fb-4d2d-982c-d2dc989a7095 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3892024-12-21T07:45:24.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1ae47656-c4b7-4771-9a22-8793f5330b0d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3902024-12-21T07:45:24.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1ae47656-c4b7-4771-9a22-8793f5330b0d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3912024-12-21T07:45:24.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1ae47656-c4b7-4771-9a22-8793f5330b0d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3922024-12-21T07:45:25.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4aa8a466-1b00-453e-b9e3-6cce912300d3 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3932024-12-21T07:45:25.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4aa8a466-1b00-453e-b9e3-6cce912300d3 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3942024-12-21T07:45:25.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4aa8a466-1b00-453e-b9e3-6cce912300d3 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3952024-12-21T07:45:26.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 514617f1-ed64-4211-a1f9-8e921f72f34a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3962024-12-21T07:45:26.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 514617f1-ed64-4211-a1f9-8e921f72f34a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3972024-12-21T07:45:26.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 514617f1-ed64-4211-a1f9-8e921f72f34a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3982024-12-21T07:45:27.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 16e99b39-9443-482f-a960-7c44a146126d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3992024-12-21T07:45:27.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 16e99b39-9443-482f-a960-7c44a146126d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4002024-12-21T07:45:27.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 16e99b39-9443-482f-a960-7c44a146126d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4012024-12-21T07:45:28.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f3c8b8d5-8ebd-4eb1-ba40-99d05a16a02a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4022024-12-21T07:45:28.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f3c8b8d5-8ebd-4eb1-ba40-99d05a16a02a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4032024-12-21T07:45:28.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f3c8b8d5-8ebd-4eb1-ba40-99d05a16a02a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4042024-12-21T07:45:29.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1052e6f1-4ff7-42d0-b830-c8a18bc8bb37 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4052024-12-21T07:45:29.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1052e6f1-4ff7-42d0-b830-c8a18bc8bb37 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4062024-12-21T07:45:29.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1052e6f1-4ff7-42d0-b830-c8a18bc8bb37 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4072024-12-21T07:45:29.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1288 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 4e4b6317-f13d-4876-9661-8025bd57ff8a response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
4082024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
4092024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4102024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
4112024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
4122024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4132024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4142024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
4152024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4162024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
4172024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4182024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4192024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
4202024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4212024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
4222024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4232024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
4242024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
4252024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4262024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4272024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
4282024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4292024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
4302024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
4312024-12-21T07:45:30.665ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4322024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4332024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
4342024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4352024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4362024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
4372024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4382024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
4392024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4402024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
4412024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
4422024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4432024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4442024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4452024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
4462024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4472024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4482024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4492024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4502024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4512024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4522024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4532024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4542024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4552024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4562024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4572024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
4582024-12-21T07:45:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4592024-12-21T07:45:30.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4602024-12-21T07:45:30.668ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4612024-12-21T07:45:30.669ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.997777ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4622024-12-21T07:45:30.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
4632024-12-21T07:45:30.670ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4642024-12-21T07:45:30.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4652024-12-21T07:45:30.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4662024-12-21T07:45:30.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4672024-12-21T07:45:30.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4682024-12-21T07:45:30.673ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1064, tv_nsec: 374465393 } })
4692024-12-21T07:45:30.674ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
4702024-12-21T07:45:30.674ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4712024-12-21T07:45:30.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4722024-12-21T07:45:30.675ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4732024-12-21T07:45:30.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4742024-12-21T07:45:30.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
4752024-12-21T07:45:30.677ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4762024-12-21T07:45:30.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4772024-12-21T07:45:30.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
4782024-12-21T07:45:30.677ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4792024-12-21T07:45:30.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4802024-12-21T07:45:30.682ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1064, tv_nsec: 382974095 } })
4812024-12-21T07:45:30.682ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
4822024-12-21T07:45:30.686ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4832024-12-21T07:45:30.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4842024-12-21T07:45:30.688ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4852024-12-21T07:45:30.689ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4862024-12-21T07:45:30.689ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1064, tv_nsec: 389908870 } })
4872024-12-21T07:45:30.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4882024-12-21T07:45:30.689ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
4892024-12-21T07:45:30.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4902024-12-21T07:45:30.691ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4912024-12-21T07:45:30.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
4922024-12-21T07:45:30.695ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4932024-12-21T07:45:30.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4942024-12-21T07:45:30.702ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4952024-12-21T07:45:30.704ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 39.419036ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
4962024-12-21T07:45:30.704ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
4972024-12-21T07:45:30.704ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4982024-12-21T07:45:30.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4992024-12-21T07:45:30.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5002024-12-21T07:45:30.708ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
5012024-12-21T07:45:30.708ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.390872ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
5022024-12-21T07:45:30.708ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5032024-12-21T07:45:30.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5042024-12-21T07:45:30.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5052024-12-21T07:45:30.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5062024-12-21T07:45:30.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5072024-12-21T07:45:30.715ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5082024-12-21T07:45:30.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5092024-12-21T07:45:30.718ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5102024-12-21T07:45:30.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5112024-12-21T07:45:30.719ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5122024-12-21T07:45:30.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5132024-12-21T07:45:30.720ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5142024-12-21T07:45:30.720ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5152024-12-21T07:45:30.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5162024-12-21T07:45:30.722ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5172024-12-21T07:45:30.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5182024-12-21T07:45:30.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
5192024-12-21T07:45:30.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5202024-12-21T07:45:30.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5212024-12-21T07:45:30.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5222024-12-21T07:45:30.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5232024-12-21T07:45:30.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.095537ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
5242024-12-21T07:45:30.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f738cb05-bffd-4d1d-9d18-d4e772b538c5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
5252024-12-21T07:45:30.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f738cb05-bffd-4d1d-9d18-d4e772b538c5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
5262024-12-21T07:45:30.726ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
5272024-12-21T07:45:30.726ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.85001ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
5282024-12-21T07:45:30.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.084553ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5292024-12-21T07:45:30.727ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5302024-12-21T07:45:30.727ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5312024-12-21T07:45:30.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5322024-12-21T07:45:30.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5332024-12-21T07:45:30.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5342024-12-21T07:45:30.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5352024-12-21T07:45:30.743ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5362024-12-21T07:45:30.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5372024-12-21T07:45:30.747ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.913983ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
5382024-12-21T07:45:30.757ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
5392024-12-21T07:45:30.757ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5402024-12-21T07:45:30.757ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "407e4b91-2f49-49cf-96f0-877206a6048e", "content-length": "26", "date": "Sat, 21 Dec 2024 07:45:29 GMT"} })
5412024-12-21T07:45:30.757ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5422024-12-21T07:45:30.759ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5432024-12-21T07:45:30.778ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5442024-12-21T07:45:30.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5452024-12-21T07:45:30.797ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
5462024-12-21T07:45:30.797ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5472024-12-21T07:45:30.797ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "df08e7b3-b3b0-4371-ae04-c657bb153b5e", "content-length": "26", "date": "Sat, 21 Dec 2024 07:45:30 GMT"} })
5482024-12-21T07:45:30.797ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5492024-12-21T07:45:30.798ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
5502024-12-21T07:45:30.805ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
5512024-12-21T07:45:30.805ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5522024-12-21T07:45:30.805ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5753f07-24d9-4ac4-8b9f-c8176bab01b0", "content-length": "26", "date": "Sat, 21 Dec 2024 07:45:30 GMT"} })
5532024-12-21T07:45:30.805ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5542024-12-21T07:45:30.807ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5552024-12-21T07:45:30.833ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
5562024-12-21T07:45:30.833ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
5572024-12-21T07:45:30.833ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "831859bf-ef63-4e4b-ad69-656f955a7011", "content-length": "372", "date": "Sat, 21 Dec 2024 07:45:29 GMT"} })
5582024-12-21T07:45:30.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5592024-12-21T07:45:30.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5602024-12-21T07:45:30.835ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 170.210722ms iteration = 6 status = 0
5612024-12-21T07:45:30.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f738cb05-bffd-4d1d-9d18-d4e772b538c5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
5622024-12-21T07:45:30.837ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5632024-12-21T07:45:30.837ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
5642024-12-21T07:45:30.837ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5652024-12-21T07:45:30.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5662024-12-21T07:45:30.859ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
5672024-12-21T07:45:30.859ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
5682024-12-21T07:45:30.860ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0edc1ed6-3c96-401d-a1bd-1667a52e8d92", "date": "Sat, 21 Dec 2024 07:45:29 GMT"} })
5692024-12-21T07:45:30.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5702024-12-21T07:45:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5712024-12-21T07:45:30.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5722024-12-21T07:45:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5732024-12-21T07:45:30.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5742024-12-21T07:45:30.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5752024-12-21T07:45:30.870ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
5762024-12-21T07:45:30.870ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
5772024-12-21T07:45:30.870ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fb52da31-6ae9-4268-9966-ad2a692f947c", "date": "Sat, 21 Dec 2024 07:45:29 GMT"} })
5782024-12-21T07:45:30.872ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 206.810541ms iteration = 7 status = {}
5792024-12-21T07:45:30.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5802024-12-21T07:45:30.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5812024-12-21T07:45:30.875ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5822024-12-21T07:45:30.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5832024-12-21T07:45:30.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 210.559723ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
5842024-12-21T07:45:30.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5852024-12-21T07:45:30.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 211.143133ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
5862024-12-21T07:45:30.878ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
5872024-12-21T07:45:30.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5882024-12-21T07:45:30.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5892024-12-21T07:45:30.878ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5902024-12-21T07:45:30.878ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
5912024-12-21T07:45:30.878ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 213.441031ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
5922024-12-21T07:45:30.884ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 218.818121ms iteration = 6 status = {}
5932024-12-21T07:45:30.913ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
5942024-12-21T07:45:30.913ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7eda8d1a-2364-4dd8-987f-2115dfd31e80", "content-length": "1", "date": "Sat, 21 Dec 2024 07:45:30 GMT"} })
5952024-12-21T07:45:30.915ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5962024-12-21T07:45:30.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5972024-12-21T07:45:30.920ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 255.37719ms iteration = 6 status = null
5982024-12-21T07:45:30.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5992024-12-21T07:45:30.922ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6002024-12-21T07:45:30.922ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6012024-12-21T07:45:30.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6022024-12-21T07:45:30.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6032024-12-21T07:45:30.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6042024-12-21T07:45:30.964ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
6052024-12-21T07:45:30.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6062024-12-21T07:45:30.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6072024-12-21T07:45:30.974ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 309.636202ms iteration = 9 status = {"physical_disks_added":0}
6082024-12-21T07:45:30.976ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
6092024-12-21T07:45:30.976ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3540774a-b603-4753-8c21-f1d402cccfcd", "content-length": "134", "date": "Sat, 21 Dec 2024 07:45:30 GMT"} })
6102024-12-21T07:45:30.977ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
6112024-12-21T07:45:30.977ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
6122024-12-21T07:45:30.977ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
6132024-12-21T07:45:30.977ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
6142024-12-21T07:45:30.977ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
6152024-12-21T07:45:30.977ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
6162024-12-21T07:45:30.977ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
6172024-12-21T07:45:30.977ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
6182024-12-21T07:45:30.977ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
6192024-12-21T07:45:30.977ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
6202024-12-21T07:45:30.977ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
6212024-12-21T07:45:30.977ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6222024-12-21T07:45:30.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6232024-12-21T07:45:30.980ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
6242024-12-21T07:45:30.980ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "00b20082-0fc1-4424-a017-9cdc72b6e102", "content-length": "2", "date": "Sat, 21 Dec 2024 07:45:30 GMT"} })
6252024-12-21T07:45:30.980ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
6262024-12-21T07:45:30.980ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ed7be31-f4c8-4325-acba-39bab5cd4306", "content-length": "52", "date": "Sat, 21 Dec 2024 07:45:30 GMT"} })
6272024-12-21T07:45:30.980ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
6282024-12-21T07:45:30.980ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
6292024-12-21T07:45:31.016ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
6302024-12-21T07:45:31.083ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ca4f650e-4c03-49b9-a493-9e6b06c019d6", "date": "Sat, 21 Dec 2024 07:45:30 GMT"} })
6312024-12-21T07:45:31.083ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
6322024-12-21T07:45:31.083ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
6332024-12-21T07:45:31.084ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "df0ce587-3e98-4500-93ac-ebdba135d34c", "content-length": "691", "date": "Sat, 21 Dec 2024 07:45:30 GMT"} })
6342024-12-21T07:45:31.084ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
6352024-12-21T07:45:31.084ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
6362024-12-21T07:45:31.084ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
6372024-12-21T07:45:31.084ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6b6983d-c73f-4508-be62-ca64c115d6ab", "content-length": "682", "date": "Sat, 21 Dec 2024 07:45:31 GMT"} })
6382024-12-21T07:45:31.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6392024-12-21T07:45:31.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6402024-12-21T07:45:31.085ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 419.844845ms iteration = 6 status = {}
6412024-12-21T07:45:31.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6422024-12-21T07:45:31.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6432024-12-21T07:45:31.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6442024-12-21T07:45:31.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6452024-12-21T07:45:31.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6462024-12-21T07:45:31.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6472024-12-21T07:45:31.100ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 435.255842ms iteration = 6 status = {}
6482024-12-21T07:45:31.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 008d764d-9c0c-4098-b820-4b985a5f3c10 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
6492024-12-21T07:45:31.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 008d764d-9c0c-4098-b820-4b985a5f3c10 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
6502024-12-21T07:45:31.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 008d764d-9c0c-4098-b820-4b985a5f3c10 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
6512024-12-21T07:45:31.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 01e0046b-e80a-43b2-a07c-c0564e95e0c4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6522024-12-21T07:45:31.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 01e0046b-e80a-43b2-a07c-c0564e95e0c4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6532024-12-21T07:45:31.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 01e0046b-e80a-43b2-a07c-c0564e95e0c4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6542024-12-21T07:45:32.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4e724b1a-31ec-4751-9619-fb394567cfaf roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6552024-12-21T07:45:32.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4e724b1a-31ec-4751-9619-fb394567cfaf resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6562024-12-21T07:45:32.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4e724b1a-31ec-4751-9619-fb394567cfaf response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6572024-12-21T07:45:33.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6e838e97-8589-4d26-8bf9-a253be9ab8ab roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6582024-12-21T07:45:33.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6e838e97-8589-4d26-8bf9-a253be9ab8ab resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6592024-12-21T07:45:33.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6e838e97-8589-4d26-8bf9-a253be9ab8ab response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6602024-12-21T07:45:34.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 52fabf39-bce4-4d74-9fc5-bee43fe236d6 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6612024-12-21T07:45:34.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 52fabf39-bce4-4d74-9fc5-bee43fe236d6 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6622024-12-21T07:45:34.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 52fabf39-bce4-4d74-9fc5-bee43fe236d6 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6632024-12-21T07:45:34.938ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:35794
6642024-12-21T07:45:34.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35794 req_id = 33bd079e-19f7-4834-ab30-b340b3804df2 roles = RoleSet { roles: {} } uri = /metrics/producers
6652024-12-21T07:45:34.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35794 req_id = 33bd079e-19f7-4834-ab30-b340b3804df2 resource = Database result = Ok(()) uri = /metrics/producers
6662024-12-21T07:45:34.978ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = e2e45dd6-1479-4aab-8030-3bcab95a4f4b
6672024-12-21T07:45:34.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39792 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35794 req_id = 33bd079e-19f7-4834-ab30-b340b3804df2 response_code = 201 uri = /metrics/producers
6682024-12-21T07:45:35.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4ff141af-d818-4988-9a57-a7fe1f7e969b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6692024-12-21T07:45:35.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4ff141af-d818-4988-9a57-a7fe1f7e969b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6702024-12-21T07:45:35.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4ff141af-d818-4988-9a57-a7fe1f7e969b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6712024-12-21T07:45:36.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 11e22346-7a6a-4a9f-aa64-f4a27844f121 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6722024-12-21T07:45:36.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 11e22346-7a6a-4a9f-aa64-f4a27844f121 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6732024-12-21T07:45:36.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 11e22346-7a6a-4a9f-aa64-f4a27844f121 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6742024-12-21T07:45:37.028ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:37914
6752024-12-21T07:45:37.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37914 req_id = ec86e400-ce79-4450-b4af-1462920b1cce roles = RoleSet { roles: {} } uri = /metrics/producers
6762024-12-21T07:45:37.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37914 req_id = ec86e400-ce79-4450-b4af-1462920b1cce resource = Database result = Ok(()) uri = /metrics/producers
6772024-12-21T07:45:37.065ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 5032d219-f3bf-40f5-8e36-efba904d39be
6782024-12-21T07:45:37.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36412 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37914 req_id = ec86e400-ce79-4450-b4af-1462920b1cce response_code = 201 uri = /metrics/producers
6792024-12-21T07:45:37.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7232cffb-03c4-4312-bacc-99eed786c311 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6802024-12-21T07:45:37.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7232cffb-03c4-4312-bacc-99eed786c311 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6812024-12-21T07:45:37.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7232cffb-03c4-4312-bacc-99eed786c311 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6822024-12-21T07:45:39.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a34fdb9d-e4a6-4ead-9a2b-16009a292a69 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6832024-12-21T07:45:39.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a34fdb9d-e4a6-4ead-9a2b-16009a292a69 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6842024-12-21T07:45:39.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a34fdb9d-e4a6-4ead-9a2b-16009a292a69 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6852024-12-21T07:45:39.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1400 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 6bb7e113-1299-4037-bb7e-577ae416da6c response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
6862024-12-21T07:45:40.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0dbcfd3e-bf02-4214-b5f2-6e1616716cf3 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6872024-12-21T07:45:40.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0dbcfd3e-bf02-4214-b5f2-6e1616716cf3 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6882024-12-21T07:45:40.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0dbcfd3e-bf02-4214-b5f2-6e1616716cf3 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6892024-12-21T07:45:40.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
6902024-12-21T07:45:40.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6912024-12-21T07:45:40.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
6922024-12-21T07:45:40.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6932024-12-21T07:45:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6942024-12-21T07:45:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6952024-12-21T07:45:40.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6962024-12-21T07:45:40.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6972024-12-21T07:45:40.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6982024-12-21T07:45:40.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6992024-12-21T07:45:40.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7002024-12-21T07:45:40.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7012024-12-21T07:45:40.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7022024-12-21T07:45:40.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
7032024-12-21T07:45:40.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7042024-12-21T07:45:40.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7052024-12-21T07:45:40.687ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
7062024-12-21T07:45:40.687ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.516425ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
7072024-12-21T07:45:40.694ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7082024-12-21T07:45:40.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7092024-12-21T07:45:40.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.259393ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7102024-12-21T07:45:41.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 259ce29a-3c47-44b5-aae6-e9032ef101ea roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7112024-12-21T07:45:41.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 259ce29a-3c47-44b5-aae6-e9032ef101ea resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7122024-12-21T07:45:41.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 259ce29a-3c47-44b5-aae6-e9032ef101ea response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7132024-12-21T07:45:41.418ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:42476
7142024-12-21T07:45:41.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42476 req_id = d2be76b5-fa82-4e8e-813a-ed654e567746 roles = RoleSet { roles: {} } uri = /metrics/producers
7152024-12-21T07:45:41.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42476 req_id = d2be76b5-fa82-4e8e-813a-ed654e567746 resource = Database result = Ok(()) uri = /metrics/producers
7162024-12-21T07:45:41.455ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 5518d5c2-1f45-4e85-8fb9-41e1149133a1
7172024-12-21T07:45:41.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37232 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42476 req_id = d2be76b5-fa82-4e8e-813a-ed654e567746 response_code = 201 uri = /metrics/producers
7182024-12-21T07:45:42.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5091c82d-2865-4cee-814c-2ea6fdc0141f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7192024-12-21T07:45:42.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5091c82d-2865-4cee-814c-2ea6fdc0141f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7202024-12-21T07:45:42.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5091c82d-2865-4cee-814c-2ea6fdc0141f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7212024-12-21T07:45:43.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5573cee6-4cda-4f30-8288-7f3975ccabc7 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7222024-12-21T07:45:43.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5573cee6-4cda-4f30-8288-7f3975ccabc7 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7232024-12-21T07:45:43.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5573cee6-4cda-4f30-8288-7f3975ccabc7 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7242024-12-21T07:45:44.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c20bbfb2-da05-453f-92c2-5f41ff049afb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7252024-12-21T07:45:44.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c20bbfb2-da05-453f-92c2-5f41ff049afb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7262024-12-21T07:45:44.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c20bbfb2-da05-453f-92c2-5f41ff049afb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7272024-12-21T07:45:45.090ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:65360
7282024-12-21T07:45:45.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65360 req_id = a154193b-64bb-4f1a-bcc2-53291619a920 roles = RoleSet { roles: {} } uri = /metrics/producers
7292024-12-21T07:45:45.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65360 req_id = a154193b-64bb-4f1a-bcc2-53291619a920 resource = Database result = Ok(()) uri = /metrics/producers
7302024-12-21T07:45:45.101ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 54344af8-3e4f-4625-a3a8-19b1290c40fc
7312024-12-21T07:45:45.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10911 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65360 req_id = a154193b-64bb-4f1a-bcc2-53291619a920 response_code = 201 uri = /metrics/producers
7322024-12-21T07:45:45.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e25d1023-39bb-4079-8a00-636ffc25d78e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7332024-12-21T07:45:45.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e25d1023-39bb-4079-8a00-636ffc25d78e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7342024-12-21T07:45:45.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e25d1023-39bb-4079-8a00-636ffc25d78e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7352024-12-21T07:45:45.277ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:46867
7362024-12-21T07:45:45.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46867 req_id = 1e88458c-dad5-452c-b169-93b8836e6422 roles = RoleSet { roles: {} } uri = /metrics/producers
7372024-12-21T07:45:45.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46867 req_id = 1e88458c-dad5-452c-b169-93b8836e6422 resource = Database result = Ok(()) uri = /metrics/producers
7382024-12-21T07:45:45.289ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 9c233aaf-fd1f-4081-b1ff-c3b56dd02b1b
7392024-12-21T07:45:45.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11277 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46867 req_id = 1e88458c-dad5-452c-b169-93b8836e6422 response_code = 201 uri = /metrics/producers
7402024-12-21T07:45:46.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2a13d17f-d453-42e0-bc72-ecf534c000ef roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7412024-12-21T07:45:46.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2a13d17f-d453-42e0-bc72-ecf534c000ef resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7422024-12-21T07:45:46.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2a13d17f-d453-42e0-bc72-ecf534c000ef response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7432024-12-21T07:45:47.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2037fab1-1308-469a-84e1-fdf662c02643 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7442024-12-21T07:45:47.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2037fab1-1308-469a-84e1-fdf662c02643 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7452024-12-21T07:45:47.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2037fab1-1308-469a-84e1-fdf662c02643 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7462024-12-21T07:45:48.209ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:37234
7472024-12-21T07:45:48.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37234 req_id = a197a2e7-00ef-4af5-834c-3bb02dc381dd roles = RoleSet { roles: {} } uri = /metrics/producers
7482024-12-21T07:45:48.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37234 req_id = a197a2e7-00ef-4af5-834c-3bb02dc381dd resource = Database result = Ok(()) uri = /metrics/producers
7492024-12-21T07:45:48.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cd5b5cf7-f7c7-4168-b220-500233019d2d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7502024-12-21T07:45:48.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cd5b5cf7-f7c7-4168-b220-500233019d2d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7512024-12-21T07:45:48.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cd5b5cf7-f7c7-4168-b220-500233019d2d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7522024-12-21T07:45:48.218ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7532024-12-21T07:45:48.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9274 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37234 req_id = a197a2e7-00ef-4af5-834c-3bb02dc381dd response_code = 201 uri = /metrics/producers
7542024-12-21T07:45:49.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bb44dba2-2147-4ae8-8a67-018b67b501cf roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7552024-12-21T07:45:49.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bb44dba2-2147-4ae8-8a67-018b67b501cf resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7562024-12-21T07:45:49.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bb44dba2-2147-4ae8-8a67-018b67b501cf response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7572024-12-21T07:45:49.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 74f53877-3cc3-4d14-ad4b-9e9cde2e20ee roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
7582024-12-21T07:45:49.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 74f53877-3cc3-4d14-ad4b-9e9cde2e20ee resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
7592024-12-21T07:45:49.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 74f53877-3cc3-4d14-ad4b-9e9cde2e20ee response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
7602024-12-21T07:45:49.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 4d67c215-24a1-498d-a13b-fddb839fc921 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
7612024-12-21T07:45:49.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 4d67c215-24a1-498d-a13b-fddb839fc921 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
7622024-12-21T07:45:49.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 4d67c215-24a1-498d-a13b-fddb839fc921 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
7632024-12-21T07:45:49.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1324 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 4bad2bd9-735f-4e9d-bd7c-f1fc315d474e response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
7642024-12-21T07:45:50.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0f7db57b-b97a-40f3-bcb3-9d22d703bc37 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7652024-12-21T07:45:50.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0f7db57b-b97a-40f3-bcb3-9d22d703bc37 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7662024-12-21T07:45:50.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0f7db57b-b97a-40f3-bcb3-9d22d703bc37 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7672024-12-21T07:45:50.664ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
7682024-12-21T07:45:50.664ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
7692024-12-21T07:45:50.664ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7702024-12-21T07:45:50.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7712024-12-21T07:45:50.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7722024-12-21T07:45:50.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7732024-12-21T07:45:50.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7742024-12-21T07:45:50.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7752024-12-21T07:45:50.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7762024-12-21T07:45:50.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7772024-12-21T07:45:50.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7782024-12-21T07:45:50.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7792024-12-21T07:45:50.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7802024-12-21T07:45:50.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
7812024-12-21T07:45:50.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7822024-12-21T07:45:50.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7832024-12-21T07:45:50.684ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
7842024-12-21T07:45:50.684ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.345751ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
7852024-12-21T07:45:50.694ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7862024-12-21T07:45:50.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7872024-12-21T07:45:50.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.186848ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7882024-12-21T07:45:51.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6763ef59-92b3-4b23-85e3-e064fd411641 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7892024-12-21T07:45:51.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6763ef59-92b3-4b23-85e3-e064fd411641 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7902024-12-21T07:45:51.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6763ef59-92b3-4b23-85e3-e064fd411641 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7912024-12-21T07:45:52.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b9c48421-5d15-4639-b9e8-04315ff3ae3b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7922024-12-21T07:45:52.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b9c48421-5d15-4639-b9e8-04315ff3ae3b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7932024-12-21T07:45:52.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2771 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b9c48421-5d15-4639-b9e8-04315ff3ae3b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7942024-12-21T07:45:53.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 69e8dc95-1d2a-49ea-9bb8-d4ddf7deb5d2 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7952024-12-21T07:45:53.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 69e8dc95-1d2a-49ea-9bb8-d4ddf7deb5d2 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7962024-12-21T07:45:53.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 69e8dc95-1d2a-49ea-9bb8-d4ddf7deb5d2 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7972024-12-21T07:45:54.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5d417d85-9dee-4b8d-bbf8-498d3a67d254 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7982024-12-21T07:45:54.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5d417d85-9dee-4b8d-bbf8-498d3a67d254 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7992024-12-21T07:45:54.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5d417d85-9dee-4b8d-bbf8-498d3a67d254 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8002024-12-21T07:45:55.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2046184d-6456-4289-b7b7-1e9fb38af8fa roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8012024-12-21T07:45:55.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2046184d-6456-4289-b7b7-1e9fb38af8fa resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8022024-12-21T07:45:55.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2046184d-6456-4289-b7b7-1e9fb38af8fa response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8032024-12-21T07:45:56.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4eda2449-3d6f-4b14-93fb-f6dcaf475011 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8042024-12-21T07:45:56.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4eda2449-3d6f-4b14-93fb-f6dcaf475011 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8052024-12-21T07:45:56.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4eda2449-3d6f-4b14-93fb-f6dcaf475011 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8062024-12-21T07:45:57.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 605c15f5-fa4a-4574-91d8-8840656013e6 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8072024-12-21T07:45:57.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 605c15f5-fa4a-4574-91d8-8840656013e6 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8082024-12-21T07:45:57.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 605c15f5-fa4a-4574-91d8-8840656013e6 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8092024-12-21T07:45:58.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 57d4d286-a736-498b-87d4-5fe6f292a02a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8102024-12-21T07:45:58.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 57d4d286-a736-498b-87d4-5fe6f292a02a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8112024-12-21T07:45:58.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 57d4d286-a736-498b-87d4-5fe6f292a02a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8122024-12-21T07:45:59.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 474f2750-a6c7-4c2a-adf2-8af97677a4c2 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8132024-12-21T07:45:59.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 474f2750-a6c7-4c2a-adf2-8af97677a4c2 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8142024-12-21T07:45:59.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 474f2750-a6c7-4c2a-adf2-8af97677a4c2 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8152024-12-21T07:45:59.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1844 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 07388f0b-97b7-4a61-8d9f-147e67c2b206 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
8162024-12-21T07:46:00.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 808218b0-a012-4c9f-93c1-639dec2169b4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8172024-12-21T07:46:00.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 808218b0-a012-4c9f-93c1-639dec2169b4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8182024-12-21T07:46:00.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 808218b0-a012-4c9f-93c1-639dec2169b4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8192024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
8202024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
8212024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
8222024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
8232024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8242024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
8252024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8262024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
8272024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
8282024-12-21T07:46:00.664ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b
8292024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
8302024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8312024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.281\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b"}
8322024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
8332024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
8342024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
8352024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8362024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
8372024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8382024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
8392024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
8402024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
8412024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
8422024-12-21T07:46:00.664ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
8432024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8442024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
8452024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
8462024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
8472024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
8482024-12-21T07:46:00.665ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
8492024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
8502024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8512024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
8522024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
8532024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8542024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
8552024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8562024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
8572024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
8582024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
8592024-12-21T07:46:00.665ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
8602024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8612024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
8622024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8632024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
8642024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
8652024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
8662024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
8672024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8682024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
8692024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8702024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
8712024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8722024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
8732024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
8742024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
8752024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
8762024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8772024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
8782024-12-21T07:46:00.665ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:36:00.665081076 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
8792024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
8802024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
8812024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
8822024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8832024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8842024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8852024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
8862024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8872024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
8882024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8892024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
8902024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8912024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
8922024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8932024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8942024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
8952024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8962024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8972024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8982024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8992024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9002024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9012024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9022024-12-21T07:46:00.665ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dd95bbd-e009-486c-8c96-451a6e195a49.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1094, tv_nsec: 366380141 } })
9032024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
9042024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9052024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9062024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9072024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
9082024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9092024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9102024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9112024-12-21T07:46:00.665ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bfae345-1659-4377-bca9-c55abec2aeb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7c426166-4f75-4a87-b9ac-c0d590aea49b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1094, tv_nsec: 366433872 } })
9122024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
9132024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9142024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9152024-12-21T07:46:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9162024-12-21T07:46:00.666ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9172024-12-21T07:46:00.666ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
9182024-12-21T07:46:00.666ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.070928ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
9192024-12-21T07:46:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9202024-12-21T07:46:00.666ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
9212024-12-21T07:46:00.666ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.516745ms iteration = 5 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
9222024-12-21T07:46:00.667ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9232024-12-21T07:46:00.668ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9242024-12-21T07:46:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.075177ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9252024-12-21T07:46:00.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9262024-12-21T07:46:00.669ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9272024-12-21T07:46:00.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9282024-12-21T07:46:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
9292024-12-21T07:46:00.670ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9302024-12-21T07:46:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9312024-12-21T07:46:00.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9322024-12-21T07:46:00.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9332024-12-21T07:46:00.680ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.161688ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
9342024-12-21T07:46:00.680ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9352024-12-21T07:46:00.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9362024-12-21T07:46:00.682ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1094, tv_nsec: 383370934 } })
9372024-12-21T07:46:00.683ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
9382024-12-21T07:46:00.683ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
9392024-12-21T07:46:00.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
9402024-12-21T07:46:00.683ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
9412024-12-21T07:46:00.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
9422024-12-21T07:46:00.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
9432024-12-21T07:46:00.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
9442024-12-21T07:46:00.684ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9452024-12-21T07:46:00.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9462024-12-21T07:46:00.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9472024-12-21T07:46:00.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9482024-12-21T07:46:00.688ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1094, tv_nsec: 389076649 } })
9492024-12-21T07:46:00.688ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
9502024-12-21T07:46:00.689ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:36:00.665081076 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
9512024-12-21T07:46:00.689ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 24.454746ms iteration = 4 status = {"expiration":"2024-12-21T07:36:00.665081076Z","pruned":[]}
9522024-12-21T07:46:00.689ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9532024-12-21T07:46:00.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9542024-12-21T07:46:00.693ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9552024-12-21T07:46:00.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9562024-12-21T07:46:00.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9572024-12-21T07:46:00.721ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9582024-12-21T07:46:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9592024-12-21T07:46:00.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9602024-12-21T07:46:00.722ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
9612024-12-21T07:46:00.722ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
9622024-12-21T07:46:00.722ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.224092ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
9632024-12-21T07:46:00.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9642024-12-21T07:46:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9652024-12-21T07:46:00.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.796682ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
9662024-12-21T07:46:00.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9672024-12-21T07:46:00.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9682024-12-21T07:46:00.724ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9692024-12-21T07:46:00.724ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
9702024-12-21T07:46:00.724ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9712024-12-21T07:46:00.725ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
9722024-12-21T07:46:00.725ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9732024-12-21T07:46:00.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9742024-12-21T07:46:00.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9752024-12-21T07:46:00.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9762024-12-21T07:46:00.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9772024-12-21T07:46:00.726ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9782024-12-21T07:46:00.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9792024-12-21T07:46:00.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9802024-12-21T07:46:00.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9812024-12-21T07:46:00.727ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9822024-12-21T07:46:00.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
9832024-12-21T07:46:00.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9842024-12-21T07:46:00.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9852024-12-21T07:46:00.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9862024-12-21T07:46:00.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9872024-12-21T07:46:00.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9882024-12-21T07:46:00.728ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9892024-12-21T07:46:00.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9902024-12-21T07:46:00.731ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9912024-12-21T07:46:00.731ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9922024-12-21T07:46:00.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9932024-12-21T07:46:00.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9942024-12-21T07:46:00.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9952024-12-21T07:46:00.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9962024-12-21T07:46:00.733ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9972024-12-21T07:46:00.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9982024-12-21T07:46:00.733ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9992024-12-21T07:46:00.734ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10002024-12-21T07:46:00.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10012024-12-21T07:46:00.735ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.029285ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
10022024-12-21T07:46:00.735ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10032024-12-21T07:46:00.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
10042024-12-21T07:46:00.735ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10052024-12-21T07:46:00.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10062024-12-21T07:46:00.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10072024-12-21T07:46:00.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10082024-12-21T07:46:00.737ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10092024-12-21T07:46:00.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10102024-12-21T07:46:00.738ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10112024-12-21T07:46:00.739ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10122024-12-21T07:46:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10132024-12-21T07:46:00.739ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1094, tv_nsec: 440541725 } })
10142024-12-21T07:46:00.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10152024-12-21T07:46:00.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10162024-12-21T07:46:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10172024-12-21T07:46:00.740ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
10182024-12-21T07:46:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
10192024-12-21T07:46:00.740ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10202024-12-21T07:46:00.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10212024-12-21T07:46:00.741ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 76.691726ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10222024-12-21T07:46:00.745ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10232024-12-21T07:46:00.746ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10242024-12-21T07:46:00.746ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 81.903263ms iteration = 3 status = {"nsuccess":5}
10252024-12-21T07:46:00.748ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10262024-12-21T07:46:00.748ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.52416ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10272024-12-21T07:46:00.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10282024-12-21T07:46:00.749ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10292024-12-21T07:46:00.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10302024-12-21T07:46:00.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
10312024-12-21T07:46:00.751ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10322024-12-21T07:46:00.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10332024-12-21T07:46:00.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10342024-12-21T07:46:00.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
10352024-12-21T07:46:00.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10362024-12-21T07:46:00.774ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10372024-12-21T07:46:00.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10382024-12-21T07:46:00.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10392024-12-21T07:46:00.776ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
10402024-12-21T07:46:00.776ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
10412024-12-21T07:46:00.776ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 111.464775ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
10422024-12-21T07:46:00.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10432024-12-21T07:46:00.777ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 112.163576ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10442024-12-21T07:46:00.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
10452024-12-21T07:46:00.780ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10462024-12-21T07:46:00.780ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 115.569674ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10472024-12-21T07:46:00.781ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
10482024-12-21T07:46:00.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
10492024-12-21T07:46:00.782ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10502024-12-21T07:46:00.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10512024-12-21T07:46:00.786ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.959939ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
10522024-12-21T07:46:00.787ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10532024-12-21T07:46:00.787ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10542024-12-21T07:46:00.787ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10552024-12-21T07:46:00.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10562024-12-21T07:46:00.789ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 124.568033ms iteration = 7 status = 0
10572024-12-21T07:46:00.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10582024-12-21T07:46:00.791ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
10592024-12-21T07:46:00.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
10602024-12-21T07:46:00.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10612024-12-21T07:46:00.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10622024-12-21T07:46:00.794ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10632024-12-21T07:46:00.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10642024-12-21T07:46:00.796ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10652024-12-21T07:46:00.798ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
10662024-12-21T07:46:00.798ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10672024-12-21T07:46:00.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10682024-12-21T07:46:00.815ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
10692024-12-21T07:46:00.815ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 150.498294ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
10702024-12-21T07:46:00.818ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
10712024-12-21T07:46:00.818ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
10722024-12-21T07:46:00.818ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
10732024-12-21T07:46:00.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10742024-12-21T07:46:00.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10752024-12-21T07:46:00.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10762024-12-21T07:46:00.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10772024-12-21T07:46:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10782024-12-21T07:46:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
10792024-12-21T07:46:00.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10802024-12-21T07:46:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10812024-12-21T07:46:00.830ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10822024-12-21T07:46:00.830ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
10832024-12-21T07:46:00.830ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 165.445343ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
10842024-12-21T07:46:00.841ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
10852024-12-21T07:46:00.841ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
10862024-12-21T07:46:00.842ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
10872024-12-21T07:46:00.842ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10882024-12-21T07:46:00.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10892024-12-21T07:46:00.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10902024-12-21T07:46:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
10912024-12-21T07:46:00.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10922024-12-21T07:46:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10932024-12-21T07:46:00.848ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
10942024-12-21T07:46:00.848ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 184.006072ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
10952024-12-21T07:46:00.867ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:42:50.264108Z, time_modified: 2024-12-21T07:42:50.264108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }) }
10962024-12-21T07:46:00.867ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 202.55455ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]}},"default_endpoint":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
10972024-12-21T07:46:00.876ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
10982024-12-21T07:46:00.876ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 0 version = 2
10992024-12-21T07:46:00.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11002024-12-21T07:46:00.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11012024-12-21T07:46:00.898ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 233.731269ms iteration = 10 status = {"physical_disks_added":0}
11022024-12-21T07:46:00.900ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
11032024-12-21T07:46:00.900ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11042024-12-21T07:46:00.901ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88de7d7c-3733-4fe2-b8b3-fc147009b20d", "content-length": "26", "date": "Sat, 21 Dec 2024 07:46:00 GMT"} })
11052024-12-21T07:46:00.901ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11062024-12-21T07:46:00.902ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
11072024-12-21T07:46:00.957ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11082024-12-21T07:46:00.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11092024-12-21T07:46:00.958ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11102024-12-21T07:46:00.958ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11112024-12-21T07:46:00.958ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "100fd4aa-83dc-4c76-8749-81aaf642e201", "content-length": "26", "date": "Sat, 21 Dec 2024 07:46:00 GMT"} })
11122024-12-21T07:46:00.958ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11132024-12-21T07:46:00.959ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11142024-12-21T07:46:00.960ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11152024-12-21T07:46:00.960ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11162024-12-21T07:46:00.960ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b014399e-021a-49dd-a0c6-ad8693ff1bba", "content-length": "26", "date": "Sat, 21 Dec 2024 07:46:00 GMT"} })
11172024-12-21T07:46:00.960ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11182024-12-21T07:46:00.962ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11192024-12-21T07:46:00.972ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
11202024-12-21T07:46:01.129ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
11212024-12-21T07:46:01.129ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3a4f2b58-23d2-4aad-927c-7bff034f156d", "date": "Sat, 21 Dec 2024 07:46:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11222024-12-21T07:46:01.129ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11232024-12-21T07:46:01.131ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "eba68bf9-7d27-4793-9d39-3d88aff7c350", "date": "Sat, 21 Dec 2024 07:46:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11242024-12-21T07:46:01.131ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11252024-12-21T07:46:01.132ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11262024-12-21T07:46:01.132ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 467.619231ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
11272024-12-21T07:46:01.143ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
11282024-12-21T07:46:01.143ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "54817170-52d0-4e72-ad3a-4db4a1492827", "date": "Sat, 21 Dec 2024 07:46:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
11292024-12-21T07:46:01.143ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
11302024-12-21T07:46:01.144ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c2ef555f-16b8-4b94-850b-bc6061fc22ff", "date": "Sat, 21 Dec 2024 07:46:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
11312024-12-21T07:46:01.144ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
11322024-12-21T07:46:01.146ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "15a84616-4677-4c23-ab89-c801fc534ac4", "date": "Sat, 21 Dec 2024 07:46:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
11332024-12-21T07:46:01.146ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
11342024-12-21T07:46:01.148ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
11352024-12-21T07:46:01.148ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 483.526035ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
11362024-12-21T07:46:01.152ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11372024-12-21T07:46:01.152ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7600704-cbdb-4e09-a6a2-a255e916fc7c", "content-length": "1", "date": "Sat, 21 Dec 2024 07:46:00 GMT"} })
11382024-12-21T07:46:01.153ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11392024-12-21T07:46:01.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11402024-12-21T07:46:01.181ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
11412024-12-21T07:46:01.181ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11422024-12-21T07:46:01.181ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "78da7aff-0fd3-46a8-8c13-777bda2c5b93", "content-length": "372", "date": "Sat, 21 Dec 2024 07:46:01 GMT"} })
11432024-12-21T07:46:01.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11442024-12-21T07:46:01.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11452024-12-21T07:46:01.184ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
11462024-12-21T07:46:01.184ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
11472024-12-21T07:46:01.184ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11482024-12-21T07:46:01.184ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11492024-12-21T07:46:01.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11502024-12-21T07:46:01.184ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11512024-12-21T07:46:01.185ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 520.808696ms iteration = 7 status = null
11522024-12-21T07:46:01.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11532024-12-21T07:46:01.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11542024-12-21T07:46:01.187ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11552024-12-21T07:46:01.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11562024-12-21T07:46:01.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11572024-12-21T07:46:01.187ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11582024-12-21T07:46:01.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11592024-12-21T07:46:01.190ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 1 version = 2
11602024-12-21T07:46:01.190ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
11612024-12-21T07:46:01.190ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:43:41.075205 UTC dns_group = external generation = 2
11622024-12-21T07:46:01.190ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 525.22507ms iteration = 5 status = {"generation":2}
11632024-12-21T07:46:01.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11642024-12-21T07:46:01.190ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11652024-12-21T07:46:01.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11662024-12-21T07:46:01.193ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
11672024-12-21T07:46:01.193ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
11682024-12-21T07:46:01.193ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:43:39.444085 UTC dns_group = internal generation = 1
11692024-12-21T07:46:01.193ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 528.610696ms iteration = 5 status = {"generation":1}
11702024-12-21T07:46:01.207ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 542.434606ms iteration = 7 status = {}
11712024-12-21T07:46:01.220ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11722024-12-21T07:46:01.222ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11732024-12-21T07:46:01.222ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11742024-12-21T07:46:01.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11752024-12-21T07:46:01.229ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
11762024-12-21T07:46:01.229ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11772024-12-21T07:46:01.229ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a30d7aa7-16e9-4085-88be-8ba5483f99de", "date": "Sat, 21 Dec 2024 07:46:01 GMT"} })
11782024-12-21T07:46:01.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11792024-12-21T07:46:01.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11802024-12-21T07:46:01.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11812024-12-21T07:46:01.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11822024-12-21T07:46:01.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11832024-12-21T07:46:01.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11842024-12-21T07:46:01.241ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11852024-12-21T07:46:01.241ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11862024-12-21T07:46:01.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11872024-12-21T07:46:01.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11882024-12-21T07:46:01.241ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f7ac4f19-fccc-4c29-be9f-7b411b5ed9ef", "date": "Sat, 21 Dec 2024 07:46:01 GMT"} })
11892024-12-21T07:46:01.242ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 577.588131ms iteration = 8 status = {}
11902024-12-21T07:46:01.242ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
11912024-12-21T07:46:01.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11922024-12-21T07:46:01.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11932024-12-21T07:46:01.252ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11942024-12-21T07:46:01.252ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5208a7db-d1d7-4ea1-808d-f1243c702b6f", "content-length": "134", "date": "Sat, 21 Dec 2024 07:46:00 GMT"} })
11952024-12-21T07:46:01.252ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
11962024-12-21T07:46:01.252ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
11972024-12-21T07:46:01.253ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
11982024-12-21T07:46:01.253ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11992024-12-21T07:46:01.253ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12002024-12-21T07:46:01.253ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12012024-12-21T07:46:01.253ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12022024-12-21T07:46:01.253ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12032024-12-21T07:46:01.253ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12042024-12-21T07:46:01.253ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12052024-12-21T07:46:01.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = a62b121a-747f-4aef-b2d0-1aff58e70f76 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
12062024-12-21T07:46:01.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = a62b121a-747f-4aef-b2d0-1aff58e70f76 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
12072024-12-21T07:46:01.253ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
12082024-12-21T07:46:01.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12092024-12-21T07:46:01.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12102024-12-21T07:46:01.256ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
12112024-12-21T07:46:01.256ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9929e18d-1edb-46b4-9413-1e60e4653de2", "content-length": "2", "date": "Sat, 21 Dec 2024 07:46:00 GMT"} })
12122024-12-21T07:46:01.256ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
12132024-12-21T07:46:01.256ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "462280a6-53c9-4300-bc92-ebdb8e7c8628", "content-length": "52", "date": "Sat, 21 Dec 2024 07:46:00 GMT"} })
12142024-12-21T07:46:01.256ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
12152024-12-21T07:46:01.256ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
12162024-12-21T07:46:01.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = a62b121a-747f-4aef-b2d0-1aff58e70f76 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
12172024-12-21T07:46:01.313ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12182024-12-21T07:46:01.350ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "08d9a5fc-1493-4959-a4d8-da5925055684", "date": "Sat, 21 Dec 2024 07:46:01 GMT"} })
12192024-12-21T07:46:01.350ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
12202024-12-21T07:46:01.350ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
12212024-12-21T07:46:01.351ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d96cb10-0b27-4fd7-9e2b-07b5cf76b26e", "content-length": "682", "date": "Sat, 21 Dec 2024 07:46:01 GMT"} })
12222024-12-21T07:46:01.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12232024-12-21T07:46:01.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12242024-12-21T07:46:01.351ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9824450c-7202-45a7-aba3-f53096243824", "content-length": "691", "date": "Sat, 21 Dec 2024 07:46:01 GMT"} })
12252024-12-21T07:46:01.351ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
12262024-12-21T07:46:01.351ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
12272024-12-21T07:46:01.351ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
12282024-12-21T07:46:01.353ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 689.198407ms iteration = 7 status = {}
12292024-12-21T07:46:01.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12302024-12-21T07:46:01.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12312024-12-21T07:46:01.357ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12322024-12-21T07:46:01.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12332024-12-21T07:46:01.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12342024-12-21T07:46:01.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12352024-12-21T07:46:01.365ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 701.019664ms iteration = 7 status = {}
12362024-12-21T07:46:01.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ec95184f-5678-4512-98a7-921ed9888305 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12372024-12-21T07:46:01.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ec95184f-5678-4512-98a7-921ed9888305 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12382024-12-21T07:46:01.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1784 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ec95184f-5678-4512-98a7-921ed9888305 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12392024-12-21T07:46:02.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bb6d87f8-1f8f-497f-8175-978fddc125d2 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12402024-12-21T07:46:02.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bb6d87f8-1f8f-497f-8175-978fddc125d2 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12412024-12-21T07:46:02.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1630 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bb6d87f8-1f8f-497f-8175-978fddc125d2 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12422024-12-21T07:46:03.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4630535a-919b-4d0e-ba2c-4a81f968f700 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12432024-12-21T07:46:03.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4630535a-919b-4d0e-ba2c-4a81f968f700 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12442024-12-21T07:46:03.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4630535a-919b-4d0e-ba2c-4a81f968f700 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12452024-12-21T07:46:04.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d1ab82b4-1876-4250-8204-2d9a6047a1fc roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12462024-12-21T07:46:04.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d1ab82b4-1876-4250-8204-2d9a6047a1fc resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12472024-12-21T07:46:04.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d1ab82b4-1876-4250-8204-2d9a6047a1fc response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12482024-12-21T07:46:05.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b9cebf57-f54c-4066-b4bd-213401354796 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12492024-12-21T07:46:05.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b9cebf57-f54c-4066-b4bd-213401354796 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12502024-12-21T07:46:05.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b9cebf57-f54c-4066-b4bd-213401354796 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12512024-12-21T07:46:06.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0127f71a-20c4-4af4-b92b-c3eafd0dacd9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12522024-12-21T07:46:06.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0127f71a-20c4-4af4-b92b-c3eafd0dacd9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12532024-12-21T07:46:06.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0127f71a-20c4-4af4-b92b-c3eafd0dacd9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12542024-12-21T07:46:07.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f0e0a6aa-a05d-4301-bc0a-baf6a6eff4ed roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12552024-12-21T07:46:07.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f0e0a6aa-a05d-4301-bc0a-baf6a6eff4ed resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12562024-12-21T07:46:07.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1861 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f0e0a6aa-a05d-4301-bc0a-baf6a6eff4ed response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12572024-12-21T07:46:08.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 33bc0797-3fe0-4044-bb6e-703df4655488 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12582024-12-21T07:46:08.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 33bc0797-3fe0-4044-bb6e-703df4655488 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12592024-12-21T07:46:08.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2715 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 33bc0797-3fe0-4044-bb6e-703df4655488 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12602024-12-21T07:46:09.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fe113f6b-5ced-443a-8f38-fed3cd63ba4a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12612024-12-21T07:46:09.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fe113f6b-5ced-443a-8f38-fed3cd63ba4a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12622024-12-21T07:46:09.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fe113f6b-5ced-443a-8f38-fed3cd63ba4a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12632024-12-21T07:46:09.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1287 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = fbf0b8d2-f55b-4a5e-a979-acd8a664b3db response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
12642024-12-21T07:46:10.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
12652024-12-21T07:46:10.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
12662024-12-21T07:46:10.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12672024-12-21T07:46:10.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12682024-12-21T07:46:10.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12692024-12-21T07:46:10.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12702024-12-21T07:46:10.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12712024-12-21T07:46:10.668ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12722024-12-21T07:46:10.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12732024-12-21T07:46:10.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12742024-12-21T07:46:10.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12752024-12-21T07:46:10.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12762024-12-21T07:46:10.670ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.934562ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12772024-12-21T07:46:10.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12782024-12-21T07:46:10.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12792024-12-21T07:46:10.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12802024-12-21T07:46:10.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
12812024-12-21T07:46:10.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12822024-12-21T07:46:10.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12832024-12-21T07:46:10.683ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
12842024-12-21T07:46:10.683ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.969439ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
12852024-12-21T07:46:10.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 18a27367-a005-433c-84fa-fd7b591dc7dc roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12862024-12-21T07:46:10.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 18a27367-a005-433c-84fa-fd7b591dc7dc resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12872024-12-21T07:46:10.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 18a27367-a005-433c-84fa-fd7b591dc7dc response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12882024-12-21T07:46:11.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e9f13bb2-c8a5-4b1f-b97a-86d1c82217b6 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12892024-12-21T07:46:11.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e9f13bb2-c8a5-4b1f-b97a-86d1c82217b6 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12902024-12-21T07:46:11.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e9f13bb2-c8a5-4b1f-b97a-86d1c82217b6 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
12912024-12-21T07:46:12.602ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
12922024-12-21T07:46:12.602ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
12932024-12-21T07:46:12.633ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
12942024-12-21T07:46:12.633ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:47028
12952024-12-21T07:46:12.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:47028 req_id = 21d0a2ea-7476-4bad-a0d9-f51c2b7d6ba2 roles = RoleSet { roles: {} } uri = /metrics/producers
12962024-12-21T07:46:12.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:47028 req_id = 21d0a2ea-7476-4bad-a0d9-f51c2b7d6ba2 resource = Database result = Ok(()) uri = /metrics/producers
12972024-12-21T07:46:12.668ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = a920b126-b55b-45c8-9984-5279bf662759
12982024-12-21T07:46:12.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34968 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:47028 req_id = 21d0a2ea-7476-4bad-a0d9-f51c2b7d6ba2 response_code = 201 uri = /metrics/producers
12992024-12-21T07:46:12.668ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "21d0a2ea-7476-4bad-a0d9-f51c2b7d6ba2", "content-length": "41", "date": "Sat, 21 Dec 2024 07:46:12 GMT"} })
13002024-12-21T07:46:12.670ZDEBGnexus (producer-registration-task): registered with nexus successfully
13012024-12-21T07:46:12.670ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
13022024-12-21T07:46:12.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7ade114-919e-4922-a2db-24ac1d8afad9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13032024-12-21T07:46:12.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7ade114-919e-4922-a2db-24ac1d8afad9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13042024-12-21T07:46:12.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7ade114-919e-4922-a2db-24ac1d8afad9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13052024-12-21T07:46:13.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 56df22cb-5eed-47a9-8ec3-300ecc30da4d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13062024-12-21T07:46:13.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 56df22cb-5eed-47a9-8ec3-300ecc30da4d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13072024-12-21T07:46:13.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 56df22cb-5eed-47a9-8ec3-300ecc30da4d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13082024-12-21T07:46:14.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2d5f621f-21c8-4fdc-a5e6-6a061877c00c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13092024-12-21T07:46:14.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2d5f621f-21c8-4fdc-a5e6-6a061877c00c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13102024-12-21T07:46:14.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2d5f621f-21c8-4fdc-a5e6-6a061877c00c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13112024-12-21T07:46:15.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 50702e90-e26b-4297-9c48-5046e42beb30 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13122024-12-21T07:46:15.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 50702e90-e26b-4297-9c48-5046e42beb30 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13132024-12-21T07:46:15.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 50702e90-e26b-4297-9c48-5046e42beb30 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13142024-12-21T07:46:16.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5b91cb89-c665-42e0-9f39-8e19542ec69d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13152024-12-21T07:46:16.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5b91cb89-c665-42e0-9f39-8e19542ec69d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13162024-12-21T07:46:16.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5b91cb89-c665-42e0-9f39-8e19542ec69d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13172024-12-21T07:46:17.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7928e842-fb08-4c59-aa5b-a07938ec4a2c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13182024-12-21T07:46:17.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7928e842-fb08-4c59-aa5b-a07938ec4a2c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13192024-12-21T07:46:17.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7928e842-fb08-4c59-aa5b-a07938ec4a2c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13202024-12-21T07:46:18.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2a321008-58bd-4ea5-9be2-1acc547a5116 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13212024-12-21T07:46:18.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2a321008-58bd-4ea5-9be2-1acc547a5116 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13222024-12-21T07:46:18.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2a321008-58bd-4ea5-9be2-1acc547a5116 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13232024-12-21T07:46:19.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1367 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 93da1710-37f6-4f7a-b8c9-187bdf26c429 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
13242024-12-21T07:46:19.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 825cf91e-5a51-46da-9dc2-013d3cee389f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13252024-12-21T07:46:19.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 825cf91e-5a51-46da-9dc2-013d3cee389f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13262024-12-21T07:46:19.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 825cf91e-5a51-46da-9dc2-013d3cee389f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13272024-12-21T07:46:20.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
13282024-12-21T07:46:20.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
13292024-12-21T07:46:20.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13302024-12-21T07:46:20.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13312024-12-21T07:46:20.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13322024-12-21T07:46:20.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13332024-12-21T07:46:20.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13342024-12-21T07:46:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13352024-12-21T07:46:20.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13362024-12-21T07:46:20.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.59124ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13372024-12-21T07:46:20.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13382024-12-21T07:46:20.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13392024-12-21T07:46:20.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13402024-12-21T07:46:20.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13412024-12-21T07:46:20.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13422024-12-21T07:46:20.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13432024-12-21T07:46:20.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
13442024-12-21T07:46:20.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13452024-12-21T07:46:20.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13462024-12-21T07:46:20.688ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
13472024-12-21T07:46:20.688ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.782299ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
13482024-12-21T07:46:20.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f00a198a-844e-49a9-9a75-6ab617819f8c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13492024-12-21T07:46:20.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f00a198a-844e-49a9-9a75-6ab617819f8c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13502024-12-21T07:46:20.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f00a198a-844e-49a9-9a75-6ab617819f8c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13512024-12-21T07:46:21.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 87a2e08c-9a36-49e5-ad42-56957e9ad273 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13522024-12-21T07:46:21.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 87a2e08c-9a36-49e5-ad42-56957e9ad273 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13532024-12-21T07:46:21.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1760 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 87a2e08c-9a36-49e5-ad42-56957e9ad273 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13542024-12-21T07:46:22.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b3e67f8d-0f52-4d0e-a778-4a842d42863f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13552024-12-21T07:46:22.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b3e67f8d-0f52-4d0e-a778-4a842d42863f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13562024-12-21T07:46:22.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b3e67f8d-0f52-4d0e-a778-4a842d42863f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13572024-12-21T07:46:23.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9fd481f1-887e-41fb-8bea-3b69b59387ed roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13582024-12-21T07:46:23.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9fd481f1-887e-41fb-8bea-3b69b59387ed resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13592024-12-21T07:46:23.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9fd481f1-887e-41fb-8bea-3b69b59387ed response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13602024-12-21T07:46:25.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1e491b6b-8e1b-4d08-a79e-903e2808b241 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13612024-12-21T07:46:25.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1e491b6b-8e1b-4d08-a79e-903e2808b241 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13622024-12-21T07:46:25.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1711 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1e491b6b-8e1b-4d08-a79e-903e2808b241 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13632024-12-21T07:46:26.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 80f85072-12bd-47fb-9b72-ab506c7e71e3 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13642024-12-21T07:46:26.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 80f85072-12bd-47fb-9b72-ab506c7e71e3 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13652024-12-21T07:46:26.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 80f85072-12bd-47fb-9b72-ab506c7e71e3 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13662024-12-21T07:46:27.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = aa985fa3-20ef-402d-a42a-d424e819ad02 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13672024-12-21T07:46:27.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = aa985fa3-20ef-402d-a42a-d424e819ad02 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13682024-12-21T07:46:27.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = aa985fa3-20ef-402d-a42a-d424e819ad02 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13692024-12-21T07:46:28.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 727fb0e8-0df8-4a2d-a4b2-34e82b7b7532 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13702024-12-21T07:46:28.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 727fb0e8-0df8-4a2d-a4b2-34e82b7b7532 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13712024-12-21T07:46:28.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 727fb0e8-0df8-4a2d-a4b2-34e82b7b7532 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13722024-12-21T07:46:29.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3377770a-9cc4-4243-9a36-43961a9385a5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13732024-12-21T07:46:29.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3377770a-9cc4-4243-9a36-43961a9385a5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13742024-12-21T07:46:29.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3377770a-9cc4-4243-9a36-43961a9385a5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13752024-12-21T07:46:29.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1404 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = b57ecfc1-4615-4184-b6cd-ecfccfc3c45f response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
13762024-12-21T07:46:30.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a321e775-f83f-4aa6-8839-2ce01e4a6c56 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13772024-12-21T07:46:30.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a321e775-f83f-4aa6-8839-2ce01e4a6c56 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13782024-12-21T07:46:30.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1656 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a321e775-f83f-4aa6-8839-2ce01e4a6c56 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
13792024-12-21T07:46:30.664ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
13802024-12-21T07:46:30.664ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
13812024-12-21T07:46:30.664ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
13822024-12-21T07:46:30.664ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
13832024-12-21T07:46:30.664ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13842024-12-21T07:46:30.664ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
13852024-12-21T07:46:30.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13862024-12-21T07:46:30.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13872024-12-21T07:46:30.664ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13882024-12-21T07:46:30.664ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
13892024-12-21T07:46:30.664ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13902024-12-21T07:46:30.664ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
13912024-12-21T07:46:30.664ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
13922024-12-21T07:46:30.664ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
13932024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
13942024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13952024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13962024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
13972024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13982024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13992024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14002024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
14012024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14022024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
14032024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14042024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
14052024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14062024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
14072024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14082024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
14092024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
14102024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14112024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14122024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
14132024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14142024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14152024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
14162024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14172024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14182024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14192024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14202024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14212024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14222024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14232024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14242024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14252024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14262024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14272024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14282024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14292024-12-21T07:46:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14302024-12-21T07:46:30.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14312024-12-21T07:46:30.667ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.144283ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
14322024-12-21T07:46:30.668ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14332024-12-21T07:46:30.668ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.981916ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14342024-12-21T07:46:30.669ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14352024-12-21T07:46:30.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14362024-12-21T07:46:30.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14372024-12-21T07:46:30.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14382024-12-21T07:46:30.670ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14392024-12-21T07:46:30.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14402024-12-21T07:46:30.673ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1124, tv_nsec: 373988390 } })
14412024-12-21T07:46:30.673ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1124, tv_nsec: 374292045 } })
14422024-12-21T07:46:30.673ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
14432024-12-21T07:46:30.673ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
14442024-12-21T07:46:30.674ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14452024-12-21T07:46:30.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14462024-12-21T07:46:30.677ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14472024-12-21T07:46:30.678ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14482024-12-21T07:46:30.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14492024-12-21T07:46:30.679ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14502024-12-21T07:46:30.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14512024-12-21T07:46:30.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14522024-12-21T07:46:30.681ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14532024-12-21T07:46:30.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14542024-12-21T07:46:30.681ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14552024-12-21T07:46:30.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14562024-12-21T07:46:30.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14572024-12-21T07:46:30.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14582024-12-21T07:46:30.682ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14592024-12-21T07:46:30.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14602024-12-21T07:46:30.683ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1124, tv_nsec: 383971656 } })
14612024-12-21T07:46:30.683ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
14622024-12-21T07:46:30.684ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14632024-12-21T07:46:30.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14642024-12-21T07:46:30.686ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14652024-12-21T07:46:30.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14662024-12-21T07:46:30.688ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14672024-12-21T07:46:30.688ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 23.265827ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14682024-12-21T07:46:30.694ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14692024-12-21T07:46:30.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14702024-12-21T07:46:30.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14712024-12-21T07:46:30.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
14722024-12-21T07:46:30.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14732024-12-21T07:46:30.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14742024-12-21T07:46:30.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14752024-12-21T07:46:30.710ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.159771ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
14762024-12-21T07:46:30.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14772024-12-21T07:46:30.711ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14782024-12-21T07:46:30.711ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14792024-12-21T07:46:30.711ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14802024-12-21T07:46:30.711ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14812024-12-21T07:46:30.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14822024-12-21T07:46:30.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14832024-12-21T07:46:30.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 47.46186ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14842024-12-21T07:46:30.712ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14852024-12-21T07:46:30.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14862024-12-21T07:46:30.712ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14872024-12-21T07:46:30.714ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14882024-12-21T07:46:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14892024-12-21T07:46:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14902024-12-21T07:46:30.714ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14912024-12-21T07:46:30.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14922024-12-21T07:46:30.716ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 51.360495ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14932024-12-21T07:46:30.717ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14942024-12-21T07:46:30.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14952024-12-21T07:46:30.717ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
14962024-12-21T07:46:30.717ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14972024-12-21T07:46:30.717ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.90265ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
14982024-12-21T07:46:30.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14992024-12-21T07:46:30.719ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15002024-12-21T07:46:30.719ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15012024-12-21T07:46:30.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15022024-12-21T07:46:30.720ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15032024-12-21T07:46:30.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15042024-12-21T07:46:30.721ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15052024-12-21T07:46:30.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15062024-12-21T07:46:30.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
15072024-12-21T07:46:30.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15082024-12-21T07:46:30.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15092024-12-21T07:46:30.725ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 60.823742ms iteration = 8 status = 0
15102024-12-21T07:46:30.743ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15112024-12-21T07:46:30.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15122024-12-21T07:46:30.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 79.500793ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15132024-12-21T07:46:30.745ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 80.116343ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
15142024-12-21T07:46:30.748ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15152024-12-21T07:46:30.748ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15162024-12-21T07:46:30.748ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15172024-12-21T07:46:30.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15182024-12-21T07:46:30.759ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 94.221298ms iteration = 11 status = {"physical_disks_added":0}
15192024-12-21T07:46:30.769ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15202024-12-21T07:46:30.769ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15212024-12-21T07:46:30.769ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bfad7a5-30eb-4b7b-9cdb-581d38426bb1", "content-length": "26", "date": "Sat, 21 Dec 2024 07:46:30 GMT"} })
15222024-12-21T07:46:30.769ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15232024-12-21T07:46:30.771ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15242024-12-21T07:46:30.775ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15252024-12-21T07:46:30.775ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15262024-12-21T07:46:30.775ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "59a14231-4db7-4009-81b8-a07a3b3cf66f", "content-length": "26", "date": "Sat, 21 Dec 2024 07:46:30 GMT"} })
15272024-12-21T07:46:30.775ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15282024-12-21T07:46:30.777ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15292024-12-21T07:46:30.787ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15302024-12-21T07:46:30.787ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15312024-12-21T07:46:30.787ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.61003ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15322024-12-21T07:46:30.789ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15332024-12-21T07:46:30.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15342024-12-21T07:46:30.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15352024-12-21T07:46:30.793ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15362024-12-21T07:46:30.793ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15372024-12-21T07:46:30.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15382024-12-21T07:46:30.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15392024-12-21T07:46:30.797ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15402024-12-21T07:46:30.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15412024-12-21T07:46:30.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15422024-12-21T07:46:30.808ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
15432024-12-21T07:46:30.808ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15442024-12-21T07:46:30.809ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "36a1e94e-e11f-4716-aa96-c736d8cbc2e8", "content-length": "26", "date": "Sat, 21 Dec 2024 07:46:30 GMT"} })
15452024-12-21T07:46:30.809ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15462024-12-21T07:46:30.810ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
15472024-12-21T07:46:30.858ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15482024-12-21T07:46:30.858ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15492024-12-21T07:46:30.859ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "20c06407-5fb7-468f-9c0a-43eec082d7ed", "content-length": "372", "date": "Sat, 21 Dec 2024 07:46:30 GMT"} })
15502024-12-21T07:46:30.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15512024-12-21T07:46:30.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15522024-12-21T07:46:30.888ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 223.492249ms iteration = 8 status = {}
15532024-12-21T07:46:30.898ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
15542024-12-21T07:46:30.898ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f98ea9f-27a5-4427-8717-b84d592e8b42", "content-length": "1", "date": "Sat, 21 Dec 2024 07:46:30 GMT"} })
15552024-12-21T07:46:30.900ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15562024-12-21T07:46:30.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15572024-12-21T07:46:30.902ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 237.816537ms iteration = 8 status = null
15582024-12-21T07:46:30.908ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
15592024-12-21T07:46:30.908ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
15602024-12-21T07:46:30.908ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ca4b0e98-ba10-4c26-bc48-8da05f3a32b7", "date": "Sat, 21 Dec 2024 07:46:30 GMT"} })
15612024-12-21T07:46:30.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15622024-12-21T07:46:30.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15632024-12-21T07:46:31.012ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15642024-12-21T07:46:31.013ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bede5b71-b6f9-4eff-b7d3-4dd7f1c5693c", "content-length": "691", "date": "Sat, 21 Dec 2024 07:46:30 GMT"} })
15652024-12-21T07:46:31.013ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
15662024-12-21T07:46:31.013ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
15672024-12-21T07:46:31.013ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
15682024-12-21T07:46:31.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15692024-12-21T07:46:31.015ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 350.660374ms iteration = 8 status = {}
15702024-12-21T07:46:31.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15712024-12-21T07:46:31.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15722024-12-21T07:46:31.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15732024-12-21T07:46:31.026ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
15742024-12-21T07:46:31.026ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15752024-12-21T07:46:31.026ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a975a69e-c128-4ddd-8248-53615b8b64a7", "date": "Sat, 21 Dec 2024 07:46:30 GMT"} })
15762024-12-21T07:46:31.028ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 363.809873ms iteration = 9 status = {}
15772024-12-21T07:46:31.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15782024-12-21T07:46:31.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15792024-12-21T07:46:31.061ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
15802024-12-21T07:46:31.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15812024-12-21T07:46:31.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15822024-12-21T07:46:31.070ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
15832024-12-21T07:46:31.071ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "52fc1b5d-8acb-4488-a4e9-683fd7bf7c22", "content-length": "134", "date": "Sat, 21 Dec 2024 07:46:30 GMT"} })
15842024-12-21T07:46:31.071ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
15852024-12-21T07:46:31.071ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
15862024-12-21T07:46:31.071ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
15872024-12-21T07:46:31.071ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15882024-12-21T07:46:31.071ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15892024-12-21T07:46:31.071ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15902024-12-21T07:46:31.071ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15912024-12-21T07:46:31.071ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15922024-12-21T07:46:31.071ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15932024-12-21T07:46:31.071ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15942024-12-21T07:46:31.071ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
15952024-12-21T07:46:31.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15962024-12-21T07:46:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15972024-12-21T07:46:31.073ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
15982024-12-21T07:46:31.073ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f990b887-3214-4580-9d12-e2dd8a2f3445", "content-length": "2", "date": "Sat, 21 Dec 2024 07:46:30 GMT"} })
15992024-12-21T07:46:31.073ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16002024-12-21T07:46:31.073ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3f311d2-e25b-4d28-ade5-e43087dc4eef", "content-length": "52", "date": "Sat, 21 Dec 2024 07:46:30 GMT"} })
16012024-12-21T07:46:31.073ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
16022024-12-21T07:46:31.073ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16032024-12-21T07:46:31.161ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2fd2a33d-0b6d-442b-ba5c-72f8e50ffdf4", "date": "Sat, 21 Dec 2024 07:46:30 GMT"} })
16042024-12-21T07:46:31.161ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
16052024-12-21T07:46:31.161ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16062024-12-21T07:46:31.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9a590a33-cdc0-4277-8629-be6a12bedb2b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16072024-12-21T07:46:31.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9a590a33-cdc0-4277-8629-be6a12bedb2b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16082024-12-21T07:46:31.162ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d583ba95-c2c7-4124-a87d-8dc5c98bad8a", "content-length": "682", "date": "Sat, 21 Dec 2024 07:46:31 GMT"} })
16092024-12-21T07:46:31.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16102024-12-21T07:46:31.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16112024-12-21T07:46:31.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9a590a33-cdc0-4277-8629-be6a12bedb2b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16122024-12-21T07:46:31.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16132024-12-21T07:46:31.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16142024-12-21T07:46:31.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16152024-12-21T07:46:31.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16162024-12-21T07:46:31.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16172024-12-21T07:46:31.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16182024-12-21T07:46:31.180ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 515.089439ms iteration = 8 status = {}
16192024-12-21T07:46:31.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 1d635f5f-6c9f-4689-9ac9-e866c3d7ce73 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
16202024-12-21T07:46:31.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 1d635f5f-6c9f-4689-9ac9-e866c3d7ce73 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
16212024-12-21T07:46:31.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 1d635f5f-6c9f-4689-9ac9-e866c3d7ce73 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
16222024-12-21T07:46:32.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 93415ccd-05e8-430c-a229-7d8492a315af roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16232024-12-21T07:46:32.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 93415ccd-05e8-430c-a229-7d8492a315af resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16242024-12-21T07:46:32.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 93415ccd-05e8-430c-a229-7d8492a315af response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16252024-12-21T07:46:33.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b6d5f4f0-1863-431d-8542-8aae28a51ea4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16262024-12-21T07:46:33.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b6d5f4f0-1863-431d-8542-8aae28a51ea4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16272024-12-21T07:46:33.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b6d5f4f0-1863-431d-8542-8aae28a51ea4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16282024-12-21T07:46:34.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1802e38b-7357-4697-93cc-b7b88703dcbd roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16292024-12-21T07:46:34.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1802e38b-7357-4697-93cc-b7b88703dcbd resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16302024-12-21T07:46:34.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1802e38b-7357-4697-93cc-b7b88703dcbd response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16312024-12-21T07:46:35.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5a87db02-dacf-4524-92fe-d64d4da62547 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16322024-12-21T07:46:35.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5a87db02-dacf-4524-92fe-d64d4da62547 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16332024-12-21T07:46:35.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2861 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5a87db02-dacf-4524-92fe-d64d4da62547 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16342024-12-21T07:46:36.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8ad26713-1308-4978-8a79-4f8ed2ebdf33 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16352024-12-21T07:46:36.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8ad26713-1308-4978-8a79-4f8ed2ebdf33 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16362024-12-21T07:46:36.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8ad26713-1308-4978-8a79-4f8ed2ebdf33 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16372024-12-21T07:46:37.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ba6f69fc-1b73-46c1-b3c7-596fb887eb28 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16382024-12-21T07:46:37.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ba6f69fc-1b73-46c1-b3c7-596fb887eb28 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16392024-12-21T07:46:37.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ba6f69fc-1b73-46c1-b3c7-596fb887eb28 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16402024-12-21T07:46:38.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6982b984-7eb7-4dc1-bbd6-3631b1ec0611 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16412024-12-21T07:46:38.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6982b984-7eb7-4dc1-bbd6-3631b1ec0611 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16422024-12-21T07:46:38.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6982b984-7eb7-4dc1-bbd6-3631b1ec0611 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16432024-12-21T07:46:39.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 928965cd-3cb0-4957-8049-1bb157c241ee roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16442024-12-21T07:46:39.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 928965cd-3cb0-4957-8049-1bb157c241ee resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16452024-12-21T07:46:39.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 928965cd-3cb0-4957-8049-1bb157c241ee response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16462024-12-21T07:46:39.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1780 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 984dbb60-524a-4fec-9c46-f6ab3efe9ba8 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
16472024-12-21T07:46:40.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9e8d9ca2-f90b-4231-a774-18ecfb5703d4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16482024-12-21T07:46:40.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9e8d9ca2-f90b-4231-a774-18ecfb5703d4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16492024-12-21T07:46:40.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9e8d9ca2-f90b-4231-a774-18ecfb5703d4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16502024-12-21T07:46:40.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
16512024-12-21T07:46:40.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
16522024-12-21T07:46:40.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16532024-12-21T07:46:40.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16542024-12-21T07:46:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16552024-12-21T07:46:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16562024-12-21T07:46:40.694ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16572024-12-21T07:46:40.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16582024-12-21T07:46:40.700ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16592024-12-21T07:46:40.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16602024-12-21T07:46:40.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16612024-12-21T07:46:40.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16622024-12-21T07:46:40.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16632024-12-21T07:46:40.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16642024-12-21T07:46:40.707ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16652024-12-21T07:46:40.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
16662024-12-21T07:46:40.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16672024-12-21T07:46:40.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16682024-12-21T07:46:40.723ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
16692024-12-21T07:46:40.723ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.25934ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
16702024-12-21T07:46:40.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.284807ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16712024-12-21T07:46:41.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 95fc1e82-dc90-4fda-b0f8-d39e2569b19f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16722024-12-21T07:46:41.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 95fc1e82-dc90-4fda-b0f8-d39e2569b19f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16732024-12-21T07:46:41.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2522 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 95fc1e82-dc90-4fda-b0f8-d39e2569b19f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16742024-12-21T07:46:42.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e64cab6a-c199-48c2-81f9-e062fc535008 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16752024-12-21T07:46:42.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e64cab6a-c199-48c2-81f9-e062fc535008 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16762024-12-21T07:46:42.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1705 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e64cab6a-c199-48c2-81f9-e062fc535008 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16772024-12-21T07:46:43.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 06a04b43-35da-47fe-8493-aeb197a881c8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16782024-12-21T07:46:43.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 06a04b43-35da-47fe-8493-aeb197a881c8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16792024-12-21T07:46:43.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 06a04b43-35da-47fe-8493-aeb197a881c8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16802024-12-21T07:46:44.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 327b4071-6f9e-4eac-ae04-3565bf1c586f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16812024-12-21T07:46:44.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 327b4071-6f9e-4eac-ae04-3565bf1c586f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16822024-12-21T07:46:44.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 327b4071-6f9e-4eac-ae04-3565bf1c586f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16832024-12-21T07:46:45.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2349541-aa94-484c-9ad0-5436e7b37c16 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16842024-12-21T07:46:45.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2349541-aa94-484c-9ad0-5436e7b37c16 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16852024-12-21T07:46:45.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2349541-aa94-484c-9ad0-5436e7b37c16 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16862024-12-21T07:46:46.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0d2f6825-7207-4a39-8684-41a7543123ec roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16872024-12-21T07:46:46.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0d2f6825-7207-4a39-8684-41a7543123ec resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16882024-12-21T07:46:46.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0d2f6825-7207-4a39-8684-41a7543123ec response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16892024-12-21T07:46:47.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2aba63ef-a015-4067-81d1-b7dd20d6b9bf roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16902024-12-21T07:46:47.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2aba63ef-a015-4067-81d1-b7dd20d6b9bf resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16912024-12-21T07:46:47.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2aba63ef-a015-4067-81d1-b7dd20d6b9bf response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16922024-12-21T07:46:48.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e91afb73-df94-4644-9fb7-8ecd78b5f842 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16932024-12-21T07:46:48.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e91afb73-df94-4644-9fb7-8ecd78b5f842 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16942024-12-21T07:46:48.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e91afb73-df94-4644-9fb7-8ecd78b5f842 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16952024-12-21T07:46:49.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 86c6086a-931d-4794-a927-f0a49ef9a9d5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16962024-12-21T07:46:49.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 86c6086a-931d-4794-a927-f0a49ef9a9d5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16972024-12-21T07:46:49.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 86c6086a-931d-4794-a927-f0a49ef9a9d5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16982024-12-21T07:46:49.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 990280db-1534-4a3b-993b-2e8f2a2e7879 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
16992024-12-21T07:46:49.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 990280db-1534-4a3b-993b-2e8f2a2e7879 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
17002024-12-21T07:46:49.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 990280db-1534-4a3b-993b-2e8f2a2e7879 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
17012024-12-21T07:46:49.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 8739e720-788a-4a57-a74d-257a804f8d2c roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
17022024-12-21T07:46:49.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 8739e720-788a-4a57-a74d-257a804f8d2c resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
17032024-12-21T07:46:49.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 8739e720-788a-4a57-a74d-257a804f8d2c response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
17042024-12-21T07:46:49.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1286 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 46b5abcd-80bb-4ca0-9904-7549bc06bd9c response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
17052024-12-21T07:46:50.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bfe3bd3c-84a6-4612-a05f-f755b50f7bb5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17062024-12-21T07:46:50.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bfe3bd3c-84a6-4612-a05f-f755b50f7bb5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17072024-12-21T07:46:50.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bfe3bd3c-84a6-4612-a05f-f755b50f7bb5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17082024-12-21T07:46:50.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
17092024-12-21T07:46:50.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
17102024-12-21T07:46:50.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17112024-12-21T07:46:50.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17122024-12-21T07:46:50.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17132024-12-21T07:46:50.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17142024-12-21T07:46:50.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17152024-12-21T07:46:50.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17162024-12-21T07:46:50.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17172024-12-21T07:46:50.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.6016ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17182024-12-21T07:46:50.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17192024-12-21T07:46:50.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17202024-12-21T07:46:50.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17212024-12-21T07:46:50.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17222024-12-21T07:46:50.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17232024-12-21T07:46:50.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17242024-12-21T07:46:50.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
17252024-12-21T07:46:50.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17262024-12-21T07:46:50.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17272024-12-21T07:46:50.687ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
17282024-12-21T07:46:50.687ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.828343ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
17292024-12-21T07:46:51.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 25981c1c-1409-4638-9c77-291c49477d9d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17302024-12-21T07:46:51.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 25981c1c-1409-4638-9c77-291c49477d9d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17312024-12-21T07:46:51.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 25981c1c-1409-4638-9c77-291c49477d9d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17322024-12-21T07:46:52.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e09f7fc7-fa4e-4aeb-b9bb-8b0f102f12a5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17332024-12-21T07:46:52.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e09f7fc7-fa4e-4aeb-b9bb-8b0f102f12a5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17342024-12-21T07:46:52.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e09f7fc7-fa4e-4aeb-b9bb-8b0f102f12a5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17352024-12-21T07:46:53.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 01e582eb-ed49-44df-838e-9c1a1503f890 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17362024-12-21T07:46:53.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 01e582eb-ed49-44df-838e-9c1a1503f890 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17372024-12-21T07:46:53.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 01e582eb-ed49-44df-838e-9c1a1503f890 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17382024-12-21T07:46:54.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 797c9cff-70a5-4f61-87c9-3a39ff5cd6fa roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17392024-12-21T07:46:54.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 797c9cff-70a5-4f61-87c9-3a39ff5cd6fa resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17402024-12-21T07:46:54.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 797c9cff-70a5-4f61-87c9-3a39ff5cd6fa response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17412024-12-21T07:46:55.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a6a47002-bff4-4568-af80-1beaed085011 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17422024-12-21T07:46:55.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a6a47002-bff4-4568-af80-1beaed085011 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17432024-12-21T07:46:55.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2638 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a6a47002-bff4-4568-af80-1beaed085011 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17442024-12-21T07:46:56.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0350d719-a834-4ffd-a14f-0e0e4ef47007 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17452024-12-21T07:46:56.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0350d719-a834-4ffd-a14f-0e0e4ef47007 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17462024-12-21T07:46:56.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0350d719-a834-4ffd-a14f-0e0e4ef47007 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17472024-12-21T07:46:57.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5ca466ea-865f-465b-bf29-59b76ebc9e74 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17482024-12-21T07:46:57.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5ca466ea-865f-465b-bf29-59b76ebc9e74 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17492024-12-21T07:46:57.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5ca466ea-865f-465b-bf29-59b76ebc9e74 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17502024-12-21T07:46:58.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 82461dbe-dc35-44e0-b724-ca034f49fa2c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17512024-12-21T07:46:58.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 82461dbe-dc35-44e0-b724-ca034f49fa2c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17522024-12-21T07:46:58.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 82461dbe-dc35-44e0-b724-ca034f49fa2c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17532024-12-21T07:46:59.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1510 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = f9a02bd2-26c5-4481-9609-64475dbf612f response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
17542024-12-21T07:46:59.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2f6e11bf-0968-4830-886b-fd37b7bf8cb8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17552024-12-21T07:46:59.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2f6e11bf-0968-4830-886b-fd37b7bf8cb8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17562024-12-21T07:46:59.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2f6e11bf-0968-4830-886b-fd37b7bf8cb8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17572024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
17582024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
17592024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
17602024-12-21T07:47:00.665ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
17612024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
17622024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17632024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17642024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
17652024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
17662024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
17672024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17682024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
17692024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
17702024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
17712024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17722024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17732024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
17742024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
17752024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17762024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17772024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17782024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
17792024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
17802024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17812024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
17822024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
17832024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
17842024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17852024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
17862024-12-21T07:47:00.665ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
17872024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17882024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17892024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
17902024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17912024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
17922024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
17932024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17942024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
17952024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17962024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
17972024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
17982024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17992024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
18002024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
18012024-12-21T07:47:00.665ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:37:00.665750891 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
18022024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
18032024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
18042024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18052024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
18062024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
18072024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18082024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
18092024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18102024-12-21T07:47:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
18112024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18122024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
18132024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
18142024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
18152024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18162024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
18172024-12-21T07:47:00.666ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b
18182024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.741\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b"}
18192024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18202024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18212024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18222024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18232024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18242024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18252024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
18262024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
18272024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18282024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18292024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18302024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18312024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18322024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18332024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18342024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18352024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
18362024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18372024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18382024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18392024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18402024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18412024-12-21T07:47:00.666ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dd95bbd-e009-486c-8c96-451a6e195a49.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1154, tv_nsec: 367120309 } })
18422024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18432024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
18442024-12-21T07:47:00.666ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bfae345-1659-4377-bca9-c55abec2aeb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7c426166-4f75-4a87-b9ac-c0d590aea49b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1154, tv_nsec: 367233001 } })
18452024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
18462024-12-21T07:47:00.666ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.232331ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
18472024-12-21T07:47:00.667ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
18482024-12-21T07:47:00.667ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.572187ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
18492024-12-21T07:47:00.668ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18502024-12-21T07:47:00.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18512024-12-21T07:47:00.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18522024-12-21T07:47:00.670ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18532024-12-21T07:47:00.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18542024-12-21T07:47:00.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
18552024-12-21T07:47:00.671ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18562024-12-21T07:47:00.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18572024-12-21T07:47:00.673ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18582024-12-21T07:47:00.675ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 9.01094ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18592024-12-21T07:47:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18602024-12-21T07:47:00.676ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18612024-12-21T07:47:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18622024-12-21T07:47:00.677ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.722195ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
18632024-12-21T07:47:00.677ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18642024-12-21T07:47:00.677ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18652024-12-21T07:47:00.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18662024-12-21T07:47:00.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18672024-12-21T07:47:00.680ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18682024-12-21T07:47:00.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18692024-12-21T07:47:00.682ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18702024-12-21T07:47:00.682ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1154, tv_nsec: 383509672 } })
18712024-12-21T07:47:00.683ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
18722024-12-21T07:47:00.683ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:37:00.665750891 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
18732024-12-21T07:47:00.684ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.241624ms iteration = 5 status = {"expiration":"2024-12-21T07:37:00.665750891Z","pruned":[]}
18742024-12-21T07:47:00.684ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1154, tv_nsec: 385215650 } })
18752024-12-21T07:47:00.684ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
18762024-12-21T07:47:00.685ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18772024-12-21T07:47:00.685ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18782024-12-21T07:47:00.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18792024-12-21T07:47:00.687ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18802024-12-21T07:47:00.688ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18812024-12-21T07:47:00.690ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18822024-12-21T07:47:00.690ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18832024-12-21T07:47:00.690ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18842024-12-21T07:47:00.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18852024-12-21T07:47:00.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18862024-12-21T07:47:00.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18872024-12-21T07:47:00.691ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18882024-12-21T07:47:00.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18892024-12-21T07:47:00.692ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.078451ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18902024-12-21T07:47:00.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18912024-12-21T07:47:00.695ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18922024-12-21T07:47:00.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18932024-12-21T07:47:00.695ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18942024-12-21T07:47:00.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18952024-12-21T07:47:00.697ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1154, tv_nsec: 397778809 } })
18962024-12-21T07:47:00.697ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
18972024-12-21T07:47:00.698ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
18982024-12-21T07:47:00.698ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 32.912577ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
18992024-12-21T07:47:00.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19002024-12-21T07:47:00.705ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19012024-12-21T07:47:00.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19022024-12-21T07:47:00.708ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19032024-12-21T07:47:00.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19042024-12-21T07:47:00.712ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19052024-12-21T07:47:00.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19062024-12-21T07:47:00.720ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19072024-12-21T07:47:00.720ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
19082024-12-21T07:47:00.720ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
19092024-12-21T07:47:00.720ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 55.098887ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
19102024-12-21T07:47:00.721ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19112024-12-21T07:47:00.723ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.163938ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
19122024-12-21T07:47:00.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19132024-12-21T07:47:00.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19142024-12-21T07:47:00.724ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19152024-12-21T07:47:00.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19162024-12-21T07:47:00.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19172024-12-21T07:47:00.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19182024-12-21T07:47:00.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19192024-12-21T07:47:00.725ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 59.808305ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19202024-12-21T07:47:00.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19212024-12-21T07:47:00.725ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19222024-12-21T07:47:00.725ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19232024-12-21T07:47:00.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19242024-12-21T07:47:00.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19252024-12-21T07:47:00.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19262024-12-21T07:47:00.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19272024-12-21T07:47:00.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19282024-12-21T07:47:00.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19292024-12-21T07:47:00.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19302024-12-21T07:47:00.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19312024-12-21T07:47:00.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19322024-12-21T07:47:00.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19332024-12-21T07:47:00.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19342024-12-21T07:47:00.731ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19352024-12-21T07:47:00.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19362024-12-21T07:47:00.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19372024-12-21T07:47:00.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19382024-12-21T07:47:00.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19392024-12-21T07:47:00.734ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19402024-12-21T07:47:00.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19412024-12-21T07:47:00.736ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.752057ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
19422024-12-21T07:47:00.738ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19432024-12-21T07:47:00.740ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
19442024-12-21T07:47:00.740ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
19452024-12-21T07:47:00.740ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
19462024-12-21T07:47:00.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19472024-12-21T07:47:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19482024-12-21T07:47:00.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
19492024-12-21T07:47:00.742ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19502024-12-21T07:47:00.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19512024-12-21T07:47:00.750ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
19522024-12-21T07:47:00.750ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
19532024-12-21T07:47:00.750ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 85.292819ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
19542024-12-21T07:47:00.763ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
19552024-12-21T07:47:00.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19562024-12-21T07:47:00.764ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 99.147219ms iteration = 12 status = {"physical_disks_added":0}
19572024-12-21T07:47:00.768ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19582024-12-21T07:47:00.768ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19592024-12-21T07:47:00.768ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19602024-12-21T07:47:00.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19612024-12-21T07:47:00.769ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19622024-12-21T07:47:00.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19632024-12-21T07:47:00.770ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
19642024-12-21T07:47:00.770ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
19652024-12-21T07:47:00.770ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
19662024-12-21T07:47:00.770ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19672024-12-21T07:47:00.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19682024-12-21T07:47:00.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19692024-12-21T07:47:00.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
19702024-12-21T07:47:00.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19712024-12-21T07:47:00.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19722024-12-21T07:47:00.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e597bc1b-77fc-464f-8519-8571962a0fc5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
19732024-12-21T07:47:00.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e597bc1b-77fc-464f-8519-8571962a0fc5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
19742024-12-21T07:47:00.802ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
19752024-12-21T07:47:00.803ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
19762024-12-21T07:47:00.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19772024-12-21T07:47:00.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19782024-12-21T07:47:00.840ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19792024-12-21T07:47:00.840ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19802024-12-21T07:47:00.841ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6b2843e-a3fc-48d5-8815-ab369069e9cb", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:00 GMT"} })
19812024-12-21T07:47:00.841ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19822024-12-21T07:47:00.842ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19832024-12-21T07:47:00.856ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
19842024-12-21T07:47:00.856ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19852024-12-21T07:47:00.856ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b070ab7a-bfc9-44c7-9ba7-10a0a8f9f146", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:00 GMT"} })
19862024-12-21T07:47:00.856ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19872024-12-21T07:47:00.858ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
19882024-12-21T07:47:00.940ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19892024-12-21T07:47:00.940ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19902024-12-21T07:47:00.940ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f823e24b-1622-4b6d-bc44-6ce5adbcad79", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:00 GMT"} })
19912024-12-21T07:47:00.940ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19922024-12-21T07:47:00.942ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19932024-12-21T07:47:00.966ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
19942024-12-21T07:47:00.966ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d822f1a3-3bf6-4513-a928-afdd35b26bfb", "date": "Sat, 21 Dec 2024 07:47:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19952024-12-21T07:47:00.966ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19962024-12-21T07:47:00.968ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8f1e3e1e-1b15-4fb2-b000-05fd327b655c", "date": "Sat, 21 Dec 2024 07:47:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19972024-12-21T07:47:00.968ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19982024-12-21T07:47:00.969ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
19992024-12-21T07:47:00.970ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20002024-12-21T07:47:00.970ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 304.501067ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
20012024-12-21T07:47:00.995ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20022024-12-21T07:47:00.995ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20032024-12-21T07:47:00.995ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e12a83e5-db4e-4ab2-a734-4cfc9dfe8560", "content-length": "372", "date": "Sat, 21 Dec 2024 07:47:00 GMT"} })
20042024-12-21T07:47:00.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20052024-12-21T07:47:00.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20062024-12-21T07:47:00.997ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 331.849292ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20072024-12-21T07:47:00.997ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20082024-12-21T07:47:00.998ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20092024-12-21T07:47:01.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
20102024-12-21T07:47:01.000ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20112024-12-21T07:47:01.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20122024-12-21T07:47:01.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20132024-12-21T07:47:01.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20142024-12-21T07:47:01.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20152024-12-21T07:47:01.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20162024-12-21T07:47:01.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e597bc1b-77fc-464f-8519-8571962a0fc5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
20172024-12-21T07:47:01.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20182024-12-21T07:47:01.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20192024-12-21T07:47:01.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20202024-12-21T07:47:01.008ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 342.711952ms iteration = 9 status = 0
20212024-12-21T07:47:01.009ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
20222024-12-21T07:47:01.009ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 0 version = 2
20232024-12-21T07:47:01.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20242024-12-21T07:47:01.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20252024-12-21T07:47:01.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20262024-12-21T07:47:01.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20272024-12-21T07:47:01.015ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20282024-12-21T07:47:01.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20292024-12-21T07:47:01.016ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
20302024-12-21T07:47:01.016ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 351.208824ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
20312024-12-21T07:47:01.017ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 1 version = 2
20322024-12-21T07:47:01.017ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
20332024-12-21T07:47:01.017ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:43:41.075205 UTC dns_group = external generation = 2
20342024-12-21T07:47:01.017ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 351.935356ms iteration = 6 status = {"generation":2}
20352024-12-21T07:47:01.033ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20362024-12-21T07:47:01.033ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20372024-12-21T07:47:01.033ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 367.9093ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20382024-12-21T07:47:01.037ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20392024-12-21T07:47:01.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20402024-12-21T07:47:01.039ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20412024-12-21T07:47:01.041ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20422024-12-21T07:47:01.041ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20432024-12-21T07:47:01.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20442024-12-21T07:47:01.042ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 376.779098ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
20452024-12-21T07:47:01.042ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
20462024-12-21T07:47:01.042ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
20472024-12-21T07:47:01.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20482024-12-21T07:47:01.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20492024-12-21T07:47:01.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20502024-12-21T07:47:01.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20512024-12-21T07:47:01.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20522024-12-21T07:47:01.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20532024-12-21T07:47:01.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20542024-12-21T07:47:01.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20552024-12-21T07:47:01.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20562024-12-21T07:47:01.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20572024-12-21T07:47:01.050ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20582024-12-21T07:47:01.051ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
20592024-12-21T07:47:01.051ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
20602024-12-21T07:47:01.051ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:43:39.444085 UTC dns_group = internal generation = 1
20612024-12-21T07:47:01.051ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 386.169525ms iteration = 6 status = {"generation":1}
20622024-12-21T07:47:01.052ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20632024-12-21T07:47:01.052ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20642024-12-21T07:47:01.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20652024-12-21T07:47:01.054ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
20662024-12-21T07:47:01.054ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20672024-12-21T07:47:01.055ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "afc9d807-94ae-4f73-8119-2e91116a9639", "date": "Sat, 21 Dec 2024 07:47:01 GMT"} })
20682024-12-21T07:47:01.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20692024-12-21T07:47:01.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20702024-12-21T07:47:01.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20712024-12-21T07:47:01.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20722024-12-21T07:47:01.061ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 395.380398ms iteration = 9 status = {}
20732024-12-21T07:47:01.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20742024-12-21T07:47:01.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20752024-12-21T07:47:01.069ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20762024-12-21T07:47:01.069ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20772024-12-21T07:47:01.069ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8181f09b-77df-4e63-9f64-a6227242d9cb", "date": "Sat, 21 Dec 2024 07:47:01 GMT"} })
20782024-12-21T07:47:01.071ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 405.869162ms iteration = 10 status = {}
20792024-12-21T07:47:01.085ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:42:50.264108Z, time_modified: 2024-12-21T07:42:50.264108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }) }
20802024-12-21T07:47:01.085ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 419.590661ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]}},"default_endpoint":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
20812024-12-21T07:47:01.090ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
20822024-12-21T07:47:01.091ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "31545a23-b0e7-444c-a5ac-3011d5fa0652", "date": "Sat, 21 Dec 2024 07:47:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
20832024-12-21T07:47:01.091ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
20842024-12-21T07:47:01.091ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20852024-12-21T07:47:01.091ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "36d5c7c1-36af-4fa6-a2f0-8f6a70bb702b", "content-length": "1", "date": "Sat, 21 Dec 2024 07:47:00 GMT"} })
20862024-12-21T07:47:01.093ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d98fada4-1035-47dc-8c8e-8bbbc8f63589", "date": "Sat, 21 Dec 2024 07:47:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
20872024-12-21T07:47:01.093ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
20882024-12-21T07:47:01.093ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20892024-12-21T07:47:01.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20902024-12-21T07:47:01.095ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "397d7f44-c0e4-4a1d-835a-f4dbb8a6721b", "date": "Sat, 21 Dec 2024 07:47:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
20912024-12-21T07:47:01.095ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
20922024-12-21T07:47:01.096ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 430.805278ms iteration = 9 status = null
20932024-12-21T07:47:01.096ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
20942024-12-21T07:47:01.096ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 431.192974ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
20952024-12-21T07:47:01.103ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
20962024-12-21T07:47:01.103ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 437.767383ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
20972024-12-21T07:47:01.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20982024-12-21T07:47:01.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20992024-12-21T07:47:01.187ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21002024-12-21T07:47:01.188ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1b82a92-1b36-43bf-94af-919dd893b7e0", "content-length": "691", "date": "Sat, 21 Dec 2024 07:47:01 GMT"} })
21012024-12-21T07:47:01.188ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
21022024-12-21T07:47:01.188ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
21032024-12-21T07:47:01.188ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
21042024-12-21T07:47:01.189ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 524.178611ms iteration = 9 status = {}
21052024-12-21T07:47:01.190ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
21062024-12-21T07:47:01.190ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21072024-12-21T07:47:01.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21082024-12-21T07:47:01.199ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
21092024-12-21T07:47:01.200ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c11381b2-cbb0-454a-bfdd-de26ecc60972", "content-length": "134", "date": "Sat, 21 Dec 2024 07:47:00 GMT"} })
21102024-12-21T07:47:01.200ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
21112024-12-21T07:47:01.200ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
21122024-12-21T07:47:01.200ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
21132024-12-21T07:47:01.200ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21142024-12-21T07:47:01.200ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21152024-12-21T07:47:01.200ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21162024-12-21T07:47:01.200ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21172024-12-21T07:47:01.200ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21182024-12-21T07:47:01.200ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21192024-12-21T07:47:01.200ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21202024-12-21T07:47:01.200ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
21212024-12-21T07:47:01.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21222024-12-21T07:47:01.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21232024-12-21T07:47:01.203ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
21242024-12-21T07:47:01.203ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "883d206b-94bb-481b-9581-2349997c4f5f", "content-length": "2", "date": "Sat, 21 Dec 2024 07:47:00 GMT"} })
21252024-12-21T07:47:01.203ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
21262024-12-21T07:47:01.203ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f076298b-7936-4920-bdd4-0125651621d5", "content-length": "52", "date": "Sat, 21 Dec 2024 07:47:00 GMT"} })
21272024-12-21T07:47:01.203ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
21282024-12-21T07:47:01.203ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
21292024-12-21T07:47:01.300ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "963a6d77-3a12-4883-8299-acf075890f13", "date": "Sat, 21 Dec 2024 07:47:01 GMT"} })
21302024-12-21T07:47:01.300ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
21312024-12-21T07:47:01.300ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
21322024-12-21T07:47:01.300ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f843488-2f02-4d9f-bbcc-dfeb796a6fe0", "content-length": "682", "date": "Sat, 21 Dec 2024 07:47:01 GMT"} })
21332024-12-21T07:47:01.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21342024-12-21T07:47:01.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21352024-12-21T07:47:01.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21362024-12-21T07:47:01.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21372024-12-21T07:47:01.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21382024-12-21T07:47:01.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21392024-12-21T07:47:01.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21402024-12-21T07:47:01.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21412024-12-21T07:47:01.318ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 652.12849ms iteration = 9 status = {}
21422024-12-21T07:47:01.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 1e56c02c-d558-4c80-814d-375df404b300 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
21432024-12-21T07:47:01.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 1e56c02c-d558-4c80-814d-375df404b300 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
21442024-12-21T07:47:01.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 1e56c02c-d558-4c80-814d-375df404b300 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
21452024-12-21T07:47:02.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 12ad734c-e3c6-4a48-9325-83e3921c2996 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21462024-12-21T07:47:02.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 12ad734c-e3c6-4a48-9325-83e3921c2996 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21472024-12-21T07:47:02.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 12ad734c-e3c6-4a48-9325-83e3921c2996 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21482024-12-21T07:47:03.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1a424697-ec60-4aa2-9e5f-07ffa19f1233 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21492024-12-21T07:47:03.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1a424697-ec60-4aa2-9e5f-07ffa19f1233 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21502024-12-21T07:47:03.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1a424697-ec60-4aa2-9e5f-07ffa19f1233 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21512024-12-21T07:47:04.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ba437092-16f3-401f-a268-e583fe395ccc roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21522024-12-21T07:47:04.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ba437092-16f3-401f-a268-e583fe395ccc resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21532024-12-21T07:47:04.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ba437092-16f3-401f-a268-e583fe395ccc response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21542024-12-21T07:47:05.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 10ea93e4-d22b-496d-b38f-b5e4c6da4d95 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21552024-12-21T07:47:05.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 10ea93e4-d22b-496d-b38f-b5e4c6da4d95 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21562024-12-21T07:47:05.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 10ea93e4-d22b-496d-b38f-b5e4c6da4d95 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21572024-12-21T07:47:06.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 31788559-452b-46ef-bb9b-68430bc41064 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21582024-12-21T07:47:06.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 31788559-452b-46ef-bb9b-68430bc41064 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21592024-12-21T07:47:06.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2609 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 31788559-452b-46ef-bb9b-68430bc41064 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21602024-12-21T07:47:07.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b28c36a8-4855-46aa-be8e-235c9c753be9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21612024-12-21T07:47:07.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b28c36a8-4855-46aa-be8e-235c9c753be9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21622024-12-21T07:47:07.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b28c36a8-4855-46aa-be8e-235c9c753be9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21632024-12-21T07:47:08.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 41fb8e8b-44f5-46a0-b4fc-03bfc9cc0925 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21642024-12-21T07:47:08.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 41fb8e8b-44f5-46a0-b4fc-03bfc9cc0925 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21652024-12-21T07:47:08.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 41fb8e8b-44f5-46a0-b4fc-03bfc9cc0925 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21662024-12-21T07:47:09.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 86378a48-44d5-497e-bcbe-9297d777202e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21672024-12-21T07:47:09.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 86378a48-44d5-497e-bcbe-9297d777202e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21682024-12-21T07:47:09.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 86378a48-44d5-497e-bcbe-9297d777202e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21692024-12-21T07:47:09.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1456 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 6d48e4fc-1902-4563-9cc0-72c442878934 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
21702024-12-21T07:47:10.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 944c9bec-a442-4e87-a7f2-1707194de745 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21712024-12-21T07:47:10.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 944c9bec-a442-4e87-a7f2-1707194de745 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21722024-12-21T07:47:10.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 944c9bec-a442-4e87-a7f2-1707194de745 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21732024-12-21T07:47:10.664ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
21742024-12-21T07:47:10.664ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
21752024-12-21T07:47:10.664ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21762024-12-21T07:47:10.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21772024-12-21T07:47:10.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21782024-12-21T07:47:10.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21792024-12-21T07:47:10.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21802024-12-21T07:47:10.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21812024-12-21T07:47:10.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21822024-12-21T07:47:10.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21832024-12-21T07:47:10.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21842024-12-21T07:47:10.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21852024-12-21T07:47:10.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21862024-12-21T07:47:10.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
21872024-12-21T07:47:10.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21882024-12-21T07:47:10.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21892024-12-21T07:47:10.687ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
21902024-12-21T07:47:10.687ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.330541ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
21912024-12-21T07:47:10.693ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21922024-12-21T07:47:10.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21932024-12-21T07:47:10.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.522604ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21942024-12-21T07:47:11.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 508dc788-f3a8-43be-9bd2-1a06c4d65de4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21952024-12-21T07:47:11.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 508dc788-f3a8-43be-9bd2-1a06c4d65de4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21962024-12-21T07:47:11.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 508dc788-f3a8-43be-9bd2-1a06c4d65de4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21972024-12-21T07:47:12.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 14edda73-8db9-448f-8603-d83d4c5e5231 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21982024-12-21T07:47:12.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 14edda73-8db9-448f-8603-d83d4c5e5231 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21992024-12-21T07:47:12.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 14edda73-8db9-448f-8603-d83d4c5e5231 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22002024-12-21T07:47:13.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7d16136-845c-49fb-9bb2-5e15414ca93c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22012024-12-21T07:47:13.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7d16136-845c-49fb-9bb2-5e15414ca93c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22022024-12-21T07:47:13.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2773 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7d16136-845c-49fb-9bb2-5e15414ca93c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22032024-12-21T07:47:14.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7eac3560-450c-4bf0-b340-2e9d5653ea3a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22042024-12-21T07:47:14.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7eac3560-450c-4bf0-b340-2e9d5653ea3a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22052024-12-21T07:47:14.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1643 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7eac3560-450c-4bf0-b340-2e9d5653ea3a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22062024-12-21T07:47:15.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8b4bf7ec-48d9-4555-8c33-31b72b60a03b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22072024-12-21T07:47:15.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8b4bf7ec-48d9-4555-8c33-31b72b60a03b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22082024-12-21T07:47:15.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2755 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8b4bf7ec-48d9-4555-8c33-31b72b60a03b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22092024-12-21T07:47:16.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dbce581b-d9eb-4346-a99c-518e2ebd9925 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22102024-12-21T07:47:16.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dbce581b-d9eb-4346-a99c-518e2ebd9925 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22112024-12-21T07:47:16.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dbce581b-d9eb-4346-a99c-518e2ebd9925 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22122024-12-21T07:47:17.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5ad0a0dd-ff9a-4d1f-966a-6657a074b3f2 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22132024-12-21T07:47:17.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5ad0a0dd-ff9a-4d1f-966a-6657a074b3f2 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22142024-12-21T07:47:17.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5ad0a0dd-ff9a-4d1f-966a-6657a074b3f2 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22152024-12-21T07:47:18.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4f3807d8-f11e-487e-bf53-6455734633d4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22162024-12-21T07:47:18.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4f3807d8-f11e-487e-bf53-6455734633d4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22172024-12-21T07:47:18.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2608 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4f3807d8-f11e-487e-bf53-6455734633d4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22182024-12-21T07:47:19.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 83e39e02-32a0-46b9-a3c4-4a502807dd4a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22192024-12-21T07:47:19.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 83e39e02-32a0-46b9-a3c4-4a502807dd4a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22202024-12-21T07:47:19.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 83e39e02-32a0-46b9-a3c4-4a502807dd4a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22212024-12-21T07:47:19.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1391 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 8c84112e-2e16-4b4b-8121-6f6d4a07f4cb response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
22222024-12-21T07:47:20.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 17b2e1c7-cdb4-47eb-9afa-75fd824d30c1 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22232024-12-21T07:47:20.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 17b2e1c7-cdb4-47eb-9afa-75fd824d30c1 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22242024-12-21T07:47:20.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 17b2e1c7-cdb4-47eb-9afa-75fd824d30c1 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22252024-12-21T07:47:20.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
22262024-12-21T07:47:20.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
22272024-12-21T07:47:20.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22282024-12-21T07:47:20.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22292024-12-21T07:47:20.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22302024-12-21T07:47:20.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22312024-12-21T07:47:20.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22322024-12-21T07:47:20.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22332024-12-21T07:47:20.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22342024-12-21T07:47:20.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22352024-12-21T07:47:20.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22362024-12-21T07:47:20.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22372024-12-21T07:47:20.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22382024-12-21T07:47:20.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
22392024-12-21T07:47:20.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22402024-12-21T07:47:20.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22412024-12-21T07:47:20.685ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
22422024-12-21T07:47:20.685ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.789239ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
22432024-12-21T07:47:20.694ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22442024-12-21T07:47:20.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22452024-12-21T07:47:20.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.45205ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22462024-12-21T07:47:21.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c471e0de-d9f6-447a-a0f6-c333c3a298c9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22472024-12-21T07:47:21.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c471e0de-d9f6-447a-a0f6-c333c3a298c9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22482024-12-21T07:47:21.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c471e0de-d9f6-447a-a0f6-c333c3a298c9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22492024-12-21T07:47:22.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 377a7588-eeb3-41ac-a36d-7561c82f5ae5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22502024-12-21T07:47:22.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 377a7588-eeb3-41ac-a36d-7561c82f5ae5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22512024-12-21T07:47:22.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 377a7588-eeb3-41ac-a36d-7561c82f5ae5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22522024-12-21T07:47:23.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dd160592-418b-4152-b938-222258024e02 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22532024-12-21T07:47:23.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dd160592-418b-4152-b938-222258024e02 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22542024-12-21T07:47:23.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dd160592-418b-4152-b938-222258024e02 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22552024-12-21T07:47:24.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 87604cdc-7e6c-49f3-9801-0b834e6970fe roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22562024-12-21T07:47:24.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 87604cdc-7e6c-49f3-9801-0b834e6970fe resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22572024-12-21T07:47:24.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 87604cdc-7e6c-49f3-9801-0b834e6970fe response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22582024-12-21T07:47:25.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e2a5768a-b340-4054-a8ac-80d156effc14 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22592024-12-21T07:47:25.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e2a5768a-b340-4054-a8ac-80d156effc14 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22602024-12-21T07:47:25.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e2a5768a-b340-4054-a8ac-80d156effc14 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22612024-12-21T07:47:26.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8760dd4a-a863-4319-9913-759f2f89c085 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22622024-12-21T07:47:26.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8760dd4a-a863-4319-9913-759f2f89c085 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22632024-12-21T07:47:26.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1767 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8760dd4a-a863-4319-9913-759f2f89c085 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22642024-12-21T07:47:27.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eac6e727-d6ec-4b7a-9239-8af92b9541a3 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22652024-12-21T07:47:27.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eac6e727-d6ec-4b7a-9239-8af92b9541a3 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22662024-12-21T07:47:27.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eac6e727-d6ec-4b7a-9239-8af92b9541a3 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22672024-12-21T07:47:28.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b620679b-e4da-4c8a-b2e5-0365f57c9e45 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22682024-12-21T07:47:28.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b620679b-e4da-4c8a-b2e5-0365f57c9e45 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22692024-12-21T07:47:28.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b620679b-e4da-4c8a-b2e5-0365f57c9e45 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22702024-12-21T07:47:29.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = faad060f-f579-48ac-aa27-39a7c82d0932 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22712024-12-21T07:47:29.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = faad060f-f579-48ac-aa27-39a7c82d0932 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22722024-12-21T07:47:29.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = faad060f-f579-48ac-aa27-39a7c82d0932 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22732024-12-21T07:47:29.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1308 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 6c177994-538f-46e3-95ee-f0444e842e50 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
22742024-12-21T07:47:30.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eaf53543-d98a-4aed-b6b7-407eddeefbb3 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22752024-12-21T07:47:30.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eaf53543-d98a-4aed-b6b7-407eddeefbb3 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22762024-12-21T07:47:30.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eaf53543-d98a-4aed-b6b7-407eddeefbb3 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22772024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
22782024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
22792024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
22802024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22812024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
22822024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
22832024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22842024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22852024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
22862024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22872024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
22882024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22892024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
22902024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
22912024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22922024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22932024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
22942024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22952024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22962024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
22972024-12-21T07:47:30.665ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22982024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22992024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
23002024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23012024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
23022024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23032024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
23042024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
23052024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
23062024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23072024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23082024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
23092024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23102024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
23112024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
23122024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23132024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
23142024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23152024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23162024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23172024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23182024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
23192024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23202024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23212024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23222024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23232024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23242024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23252024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23262024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23272024-12-21T07:47:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
23282024-12-21T07:47:30.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23292024-12-21T07:47:30.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23302024-12-21T07:47:30.668ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.313655ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
23312024-12-21T07:47:30.669ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23322024-12-21T07:47:30.669ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1184, tv_nsec: 370266053 } })
23332024-12-21T07:47:30.670ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
23342024-12-21T07:47:30.670ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23352024-12-21T07:47:30.671ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1184, tv_nsec: 371818409 } })
23362024-12-21T07:47:30.671ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
23372024-12-21T07:47:30.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23382024-12-21T07:47:30.671ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23392024-12-21T07:47:30.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23402024-12-21T07:47:30.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23412024-12-21T07:47:30.672ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23422024-12-21T07:47:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23432024-12-21T07:47:30.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23442024-12-21T07:47:30.678ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23452024-12-21T07:47:30.678ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23462024-12-21T07:47:30.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23472024-12-21T07:47:30.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23482024-12-21T07:47:30.679ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23492024-12-21T07:47:30.680ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23502024-12-21T07:47:30.680ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.447727ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
23512024-12-21T07:47:30.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23522024-12-21T07:47:30.682ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23532024-12-21T07:47:30.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23542024-12-21T07:47:30.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23552024-12-21T07:47:30.682ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23562024-12-21T07:47:30.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23572024-12-21T07:47:30.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23582024-12-21T07:47:30.683ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23592024-12-21T07:47:30.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23602024-12-21T07:47:30.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23612024-12-21T07:47:30.690ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23622024-12-21T07:47:30.690ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23632024-12-21T07:47:30.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23642024-12-21T07:47:30.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23652024-12-21T07:47:30.690ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23662024-12-21T07:47:30.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23672024-12-21T07:47:30.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23682024-12-21T07:47:30.692ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23692024-12-21T07:47:30.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23702024-12-21T07:47:30.692ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1184, tv_nsec: 392895340 } })
23712024-12-21T07:47:30.692ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23722024-12-21T07:47:30.692ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
23732024-12-21T07:47:30.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
23742024-12-21T07:47:30.695ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23752024-12-21T07:47:30.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23762024-12-21T07:47:30.703ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 37.750139ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
23772024-12-21T07:47:30.707ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
23782024-12-21T07:47:30.707ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 41.707364ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
23792024-12-21T07:47:30.707ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23802024-12-21T07:47:30.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23812024-12-21T07:47:30.712ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23822024-12-21T07:47:30.712ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23832024-12-21T07:47:30.712ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23842024-12-21T07:47:30.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23852024-12-21T07:47:30.713ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23862024-12-21T07:47:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23872024-12-21T07:47:30.715ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.276016ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23882024-12-21T07:47:30.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23892024-12-21T07:47:30.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23902024-12-21T07:47:30.717ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23912024-12-21T07:47:30.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23922024-12-21T07:47:30.718ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23932024-12-21T07:47:30.721ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.078684ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23942024-12-21T07:47:30.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23952024-12-21T07:47:30.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
23962024-12-21T07:47:30.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23972024-12-21T07:47:30.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23982024-12-21T07:47:30.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23992024-12-21T07:47:30.725ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 60.147821ms iteration = 10 status = 0
24002024-12-21T07:47:30.728ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24012024-12-21T07:47:30.728ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.499267ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24022024-12-21T07:47:30.730ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24032024-12-21T07:47:30.730ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
24042024-12-21T07:47:30.730ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24052024-12-21T07:47:30.730ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "52d513d7-2d89-4876-836a-4de45e201ebc", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:30 GMT"} })
24062024-12-21T07:47:30.730ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
24072024-12-21T07:47:30.730ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24082024-12-21T07:47:30.730ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24092024-12-21T07:47:30.731ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8db613da-9d49-43c6-a79c-ae854950934c", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:30 GMT"} })
24102024-12-21T07:47:30.731ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24112024-12-21T07:47:30.732ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24122024-12-21T07:47:30.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24132024-12-21T07:47:30.733ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24142024-12-21T07:47:30.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24152024-12-21T07:47:30.734ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24162024-12-21T07:47:30.740ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 75.045298ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
24172024-12-21T07:47:30.751ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24182024-12-21T07:47:30.751ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24192024-12-21T07:47:30.751ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24202024-12-21T07:47:30.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24212024-12-21T07:47:30.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24222024-12-21T07:47:30.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24232024-12-21T07:47:30.779ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 113.723652ms iteration = 13 status = {"physical_disks_added":0}
24242024-12-21T07:47:30.780ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24252024-12-21T07:47:30.780ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24262024-12-21T07:47:30.780ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.78281ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24272024-12-21T07:47:30.785ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
24282024-12-21T07:47:30.785ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24292024-12-21T07:47:30.785ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "159d3507-a5c3-4a55-a482-4ff98091e6e4", "content-length": "26", "date": "Sat, 21 Dec 2024 07:47:30 GMT"} })
24302024-12-21T07:47:30.785ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24312024-12-21T07:47:30.787ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
24322024-12-21T07:47:30.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24332024-12-21T07:47:30.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24342024-12-21T07:47:30.794ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 129.306402ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
24352024-12-21T07:47:30.836ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
24362024-12-21T07:47:30.836ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "458d504b-085d-4252-bf17-47032d02d389", "content-length": "1", "date": "Sat, 21 Dec 2024 07:47:30 GMT"} })
24372024-12-21T07:47:30.836ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 171.206199ms iteration = 10 status = {}
24382024-12-21T07:47:30.837ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24392024-12-21T07:47:30.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24402024-12-21T07:47:30.840ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 175.054013ms iteration = 10 status = null
24412024-12-21T07:47:30.861ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
24422024-12-21T07:47:30.861ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24432024-12-21T07:47:30.861ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb646e5d-424a-4642-bcb1-0a72b5bc30e6", "content-length": "372", "date": "Sat, 21 Dec 2024 07:47:29 GMT"} })
24442024-12-21T07:47:30.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24452024-12-21T07:47:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24462024-12-21T07:47:30.909ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
24472024-12-21T07:47:30.909ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
24482024-12-21T07:47:30.909ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7188aecb-3404-4d61-ab37-b1461348bf1d", "date": "Sat, 21 Dec 2024 07:47:29 GMT"} })
24492024-12-21T07:47:30.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24502024-12-21T07:47:30.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24512024-12-21T07:47:30.911ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24522024-12-21T07:47:30.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24532024-12-21T07:47:30.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24542024-12-21T07:47:30.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24552024-12-21T07:47:30.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24562024-12-21T07:47:30.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24572024-12-21T07:47:30.918ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
24582024-12-21T07:47:30.918ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24592024-12-21T07:47:30.919ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "76c44084-57c4-4e30-9578-1fddd908dddb", "date": "Sat, 21 Dec 2024 07:47:29 GMT"} })
24602024-12-21T07:47:30.920ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 255.123245ms iteration = 11 status = {}
24612024-12-21T07:47:30.951ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24622024-12-21T07:47:30.954ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24632024-12-21T07:47:30.954ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24642024-12-21T07:47:30.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24652024-12-21T07:47:30.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24662024-12-21T07:47:30.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24672024-12-21T07:47:30.956ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24682024-12-21T07:47:30.956ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
24692024-12-21T07:47:30.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24702024-12-21T07:47:30.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24712024-12-21T07:47:30.958ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24722024-12-21T07:47:30.958ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24732024-12-21T07:47:30.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24742024-12-21T07:47:30.968ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24752024-12-21T07:47:30.968ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9396f39-83a3-4cd1-a410-71228ee170d1", "content-length": "134", "date": "Sat, 21 Dec 2024 07:47:30 GMT"} })
24762024-12-21T07:47:30.968ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
24772024-12-21T07:47:30.968ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
24782024-12-21T07:47:30.969ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24792024-12-21T07:47:30.969ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24802024-12-21T07:47:30.969ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24812024-12-21T07:47:30.969ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24822024-12-21T07:47:30.969ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24832024-12-21T07:47:30.969ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24842024-12-21T07:47:30.969ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24852024-12-21T07:47:30.969ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24862024-12-21T07:47:30.969ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
24872024-12-21T07:47:30.969ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24882024-12-21T07:47:30.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24892024-12-21T07:47:30.971ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24902024-12-21T07:47:30.972ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "29fc95cd-b25c-429d-9ac9-ad866466ac44", "content-length": "2", "date": "Sat, 21 Dec 2024 07:47:30 GMT"} })
24912024-12-21T07:47:30.972ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24922024-12-21T07:47:30.972ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba7cd2c2-baae-4d4f-8065-59294c4e6e26", "content-length": "52", "date": "Sat, 21 Dec 2024 07:47:30 GMT"} })
24932024-12-21T07:47:30.972ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
24942024-12-21T07:47:30.972ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24952024-12-21T07:47:31.047ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24962024-12-21T07:47:31.071ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5f3a29a1-e814-4d1d-8549-45f2b4723df8", "date": "Sat, 21 Dec 2024 07:47:30 GMT"} })
24972024-12-21T07:47:31.071ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
24982024-12-21T07:47:31.071ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24992024-12-21T07:47:31.072ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdf392a7-0c8f-4ada-8ec2-d56ddaf27f18", "content-length": "691", "date": "Sat, 21 Dec 2024 07:47:30 GMT"} })
25002024-12-21T07:47:31.072ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
25012024-12-21T07:47:31.072ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
25022024-12-21T07:47:31.072ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
25032024-12-21T07:47:31.072ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d66e400-9cb5-44ef-a77b-7a0542f067e2", "content-length": "682", "date": "Sat, 21 Dec 2024 07:47:31 GMT"} })
25042024-12-21T07:47:31.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25052024-12-21T07:47:31.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25062024-12-21T07:47:31.073ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 408.447116ms iteration = 10 status = {}
25072024-12-21T07:47:31.076ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25082024-12-21T07:47:31.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25092024-12-21T07:47:31.080ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25102024-12-21T07:47:31.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25112024-12-21T07:47:31.083ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25122024-12-21T07:47:31.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25132024-12-21T07:47:31.090ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 425.063052ms iteration = 10 status = {}
25142024-12-21T07:47:31.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 289ebb55-ebda-4ecb-b06e-a52113c9c914 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
25152024-12-21T07:47:31.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 289ebb55-ebda-4ecb-b06e-a52113c9c914 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
25162024-12-21T07:47:31.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 289ebb55-ebda-4ecb-b06e-a52113c9c914 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
25172024-12-21T07:47:31.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a86ca619-1cf5-4ab8-976f-681de19de0f9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25182024-12-21T07:47:31.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a86ca619-1cf5-4ab8-976f-681de19de0f9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25192024-12-21T07:47:31.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a86ca619-1cf5-4ab8-976f-681de19de0f9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25202024-12-21T07:47:32.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2f7336b3-7093-462a-b926-dc70e23e1a0d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25212024-12-21T07:47:32.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2f7336b3-7093-462a-b926-dc70e23e1a0d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25222024-12-21T07:47:32.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2f7336b3-7093-462a-b926-dc70e23e1a0d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25232024-12-21T07:47:33.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = df737f00-0af0-45e4-a749-eb9f707dee2e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25242024-12-21T07:47:33.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = df737f00-0af0-45e4-a749-eb9f707dee2e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25252024-12-21T07:47:33.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = df737f00-0af0-45e4-a749-eb9f707dee2e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25262024-12-21T07:47:34.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = da08c812-e75b-4a2e-98ae-d168b2d4672c roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
25272024-12-21T07:47:34.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = da08c812-e75b-4a2e-98ae-d168b2d4672c resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
25282024-12-21T07:47:34.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = da08c812-e75b-4a2e-98ae-d168b2d4672c response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
25292024-12-21T07:47:34.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 013710d9-7b56-429f-9d30-6997bab7484f roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
25302024-12-21T07:47:34.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 013710d9-7b56-429f-9d30-6997bab7484f resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
25312024-12-21T07:47:34.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8f23dbbd-bc39-4ac9-8716-007dc82a180a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25322024-12-21T07:47:34.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8f23dbbd-bc39-4ac9-8716-007dc82a180a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25332024-12-21T07:47:34.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 013710d9-7b56-429f-9d30-6997bab7484f response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
25342024-12-21T07:47:34.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8f23dbbd-bc39-4ac9-8716-007dc82a180a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25352024-12-21T07:47:35.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3b3ea430-2663-4e40-bc21-e020f2775d57 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25362024-12-21T07:47:35.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3b3ea430-2663-4e40-bc21-e020f2775d57 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25372024-12-21T07:47:35.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3b3ea430-2663-4e40-bc21-e020f2775d57 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25382024-12-21T07:47:36.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5da54c0f-241c-4a65-a425-e26fd35a825f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25392024-12-21T07:47:36.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5da54c0f-241c-4a65-a425-e26fd35a825f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25402024-12-21T07:47:36.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5da54c0f-241c-4a65-a425-e26fd35a825f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25412024-12-21T07:47:37.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 33523412-4402-4997-950e-582f36df75ff roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25422024-12-21T07:47:37.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 33523412-4402-4997-950e-582f36df75ff resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25432024-12-21T07:47:37.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 33523412-4402-4997-950e-582f36df75ff response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25442024-12-21T07:47:38.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ffaa616a-9a45-4fbc-bbe0-0e2177853586 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25452024-12-21T07:47:38.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ffaa616a-9a45-4fbc-bbe0-0e2177853586 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25462024-12-21T07:47:38.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ffaa616a-9a45-4fbc-bbe0-0e2177853586 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25472024-12-21T07:47:39.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1470 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = b0c74f21-ad23-4247-9ba8-bba1e12ae513 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
25482024-12-21T07:47:39.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b75f7787-1cb3-4c04-bf0c-1f62bb0a0262 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25492024-12-21T07:47:39.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b75f7787-1cb3-4c04-bf0c-1f62bb0a0262 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25502024-12-21T07:47:39.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b75f7787-1cb3-4c04-bf0c-1f62bb0a0262 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25512024-12-21T07:47:40.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
25522024-12-21T07:47:40.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25532024-12-21T07:47:40.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
25542024-12-21T07:47:40.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25552024-12-21T07:47:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25562024-12-21T07:47:40.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25572024-12-21T07:47:40.695ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25582024-12-21T07:47:40.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25592024-12-21T07:47:40.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25602024-12-21T07:47:40.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25612024-12-21T07:47:40.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25622024-12-21T07:47:40.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25632024-12-21T07:47:40.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25642024-12-21T07:47:40.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25652024-12-21T07:47:40.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25662024-12-21T07:47:40.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
25672024-12-21T07:47:40.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25682024-12-21T07:47:40.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25692024-12-21T07:47:40.716ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
25702024-12-21T07:47:40.716ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.978319ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
25712024-12-21T07:47:40.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.422439ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25722024-12-21T07:47:40.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5d17dfb1-a276-4bcd-a11a-ca934dfef560 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25732024-12-21T07:47:40.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5d17dfb1-a276-4bcd-a11a-ca934dfef560 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25742024-12-21T07:47:40.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5d17dfb1-a276-4bcd-a11a-ca934dfef560 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25752024-12-21T07:47:41.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = df25af72-d124-4159-8c35-cae7e8dc7d38 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25762024-12-21T07:47:41.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = df25af72-d124-4159-8c35-cae7e8dc7d38 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25772024-12-21T07:47:41.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = df25af72-d124-4159-8c35-cae7e8dc7d38 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25782024-12-21T07:47:42.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b0a9b514-18cc-4937-9a1b-701fc7b2e16d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25792024-12-21T07:47:42.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b0a9b514-18cc-4937-9a1b-701fc7b2e16d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25802024-12-21T07:47:42.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b0a9b514-18cc-4937-9a1b-701fc7b2e16d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25812024-12-21T07:47:43.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0354dd0a-9485-4d69-aa60-d04b140b99a4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25822024-12-21T07:47:43.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0354dd0a-9485-4d69-aa60-d04b140b99a4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25832024-12-21T07:47:43.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0354dd0a-9485-4d69-aa60-d04b140b99a4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25842024-12-21T07:47:44.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7d5a4d47-9063-4bc3-8be5-413cb78bc806 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25852024-12-21T07:47:44.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7d5a4d47-9063-4bc3-8be5-413cb78bc806 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25862024-12-21T07:47:44.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2541 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7d5a4d47-9063-4bc3-8be5-413cb78bc806 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25872024-12-21T07:47:45.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = de69680f-c62a-4d8f-8ea3-1fb9132bb0c7 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25882024-12-21T07:47:45.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = de69680f-c62a-4d8f-8ea3-1fb9132bb0c7 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25892024-12-21T07:47:45.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = de69680f-c62a-4d8f-8ea3-1fb9132bb0c7 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25902024-12-21T07:47:46.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 65cd483a-4100-45b5-90ee-cff2e9913e04 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25912024-12-21T07:47:46.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 65cd483a-4100-45b5-90ee-cff2e9913e04 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25922024-12-21T07:47:46.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 65cd483a-4100-45b5-90ee-cff2e9913e04 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25932024-12-21T07:47:48.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8db532be-0712-4a23-93be-41391137f539 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25942024-12-21T07:47:48.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8db532be-0712-4a23-93be-41391137f539 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25952024-12-21T07:47:48.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8db532be-0712-4a23-93be-41391137f539 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25962024-12-21T07:47:49.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8bb145fa-a2cd-4b51-9055-791cbb838dac roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25972024-12-21T07:47:49.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8bb145fa-a2cd-4b51-9055-791cbb838dac resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25982024-12-21T07:47:49.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8bb145fa-a2cd-4b51-9055-791cbb838dac response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
25992024-12-21T07:47:49.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1291 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 69d01e81-b400-46b7-91fd-a758d5bd1b21 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
26002024-12-21T07:47:50.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1672237f-41e7-48a9-b17a-b8a2488c61be roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26012024-12-21T07:47:50.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1672237f-41e7-48a9-b17a-b8a2488c61be resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26022024-12-21T07:47:50.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2724 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1672237f-41e7-48a9-b17a-b8a2488c61be response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26032024-12-21T07:47:50.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
26042024-12-21T07:47:50.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26052024-12-21T07:47:50.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
26062024-12-21T07:47:50.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26072024-12-21T07:47:50.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26082024-12-21T07:47:50.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26092024-12-21T07:47:50.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26102024-12-21T07:47:50.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26112024-12-21T07:47:50.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26122024-12-21T07:47:50.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26132024-12-21T07:47:50.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26142024-12-21T07:47:50.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26152024-12-21T07:47:50.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26162024-12-21T07:47:50.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26172024-12-21T07:47:50.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26182024-12-21T07:47:50.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
26192024-12-21T07:47:50.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26202024-12-21T07:47:50.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26212024-12-21T07:47:50.687ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
26222024-12-21T07:47:50.687ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.953055ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
26232024-12-21T07:47:50.695ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.824903ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26242024-12-21T07:47:51.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c1d5a5a1-9e51-4aad-a5dd-11b681f872b8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26252024-12-21T07:47:51.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c1d5a5a1-9e51-4aad-a5dd-11b681f872b8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26262024-12-21T07:47:51.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c1d5a5a1-9e51-4aad-a5dd-11b681f872b8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26272024-12-21T07:47:52.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b95973e6-230b-43f7-a0a3-b188817b46b3 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26282024-12-21T07:47:52.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b95973e6-230b-43f7-a0a3-b188817b46b3 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26292024-12-21T07:47:52.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b95973e6-230b-43f7-a0a3-b188817b46b3 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26302024-12-21T07:47:53.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4373ac58-e3ac-4839-8500-054b587cff40 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26312024-12-21T07:47:53.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4373ac58-e3ac-4839-8500-054b587cff40 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26322024-12-21T07:47:53.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4373ac58-e3ac-4839-8500-054b587cff40 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26332024-12-21T07:47:54.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e0adcf22-89ad-4da1-8af4-ec7705573e09 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26342024-12-21T07:47:54.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e0adcf22-89ad-4da1-8af4-ec7705573e09 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26352024-12-21T07:47:54.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e0adcf22-89ad-4da1-8af4-ec7705573e09 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26362024-12-21T07:47:55.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5051b65c-4b76-487d-bfb9-67f5d2701b74 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26372024-12-21T07:47:55.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5051b65c-4b76-487d-bfb9-67f5d2701b74 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26382024-12-21T07:47:55.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5051b65c-4b76-487d-bfb9-67f5d2701b74 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26392024-12-21T07:47:56.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a2de1d26-3c84-49e2-a816-2250b3ff78e9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26402024-12-21T07:47:56.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a2de1d26-3c84-49e2-a816-2250b3ff78e9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26412024-12-21T07:47:56.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a2de1d26-3c84-49e2-a816-2250b3ff78e9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26422024-12-21T07:47:57.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9d146e22-3693-4aa0-a968-72ba2f34f3e4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26432024-12-21T07:47:57.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9d146e22-3693-4aa0-a968-72ba2f34f3e4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26442024-12-21T07:47:57.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9d146e22-3693-4aa0-a968-72ba2f34f3e4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26452024-12-21T07:47:58.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d69e463b-e5aa-4cc5-ba4c-daf2ed40dc08 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26462024-12-21T07:47:58.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d69e463b-e5aa-4cc5-ba4c-daf2ed40dc08 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26472024-12-21T07:47:58.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d69e463b-e5aa-4cc5-ba4c-daf2ed40dc08 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26482024-12-21T07:47:59.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dc007d0f-66d4-4b32-80f7-291982cd0bbb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26492024-12-21T07:47:59.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dc007d0f-66d4-4b32-80f7-291982cd0bbb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26502024-12-21T07:47:59.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dc007d0f-66d4-4b32-80f7-291982cd0bbb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26512024-12-21T07:47:59.741ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1336 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 29681184-1cc6-46f9-9847-bfc1fd77c86a response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
26522024-12-21T07:48:00.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d6444f69-dbc2-483b-8904-27c14b518c1b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26532024-12-21T07:48:00.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d6444f69-dbc2-483b-8904-27c14b518c1b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26542024-12-21T07:48:00.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d6444f69-dbc2-483b-8904-27c14b518c1b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26552024-12-21T07:48:00.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 4ea00ff7-f052-4f4c-9d1a-47bed90d7f18 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
26562024-12-21T07:48:00.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 4ea00ff7-f052-4f4c-9d1a-47bed90d7f18 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
26572024-12-21T07:48:00.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 4ea00ff7-f052-4f4c-9d1a-47bed90d7f18 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
26582024-12-21T07:48:00.664ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
26592024-12-21T07:48:00.664ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
26602024-12-21T07:48:00.664ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
26612024-12-21T07:48:00.664ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
26622024-12-21T07:48:00.664ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
26632024-12-21T07:48:00.664ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
26642024-12-21T07:48:00.664ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26652024-12-21T07:48:00.664ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
26662024-12-21T07:48:00.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26672024-12-21T07:48:00.664ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
26682024-12-21T07:48:00.664ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
26692024-12-21T07:48:00.664ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
26702024-12-21T07:48:00.664ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
26712024-12-21T07:48:00.664ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26722024-12-21T07:48:00.664ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26732024-12-21T07:48:00.664ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26742024-12-21T07:48:00.664ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
26752024-12-21T07:48:00.664ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
26762024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
26772024-12-21T07:48:00.665ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b
26782024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26792024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.4\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b"}
26802024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
26812024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
26822024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
26832024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26842024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
26852024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26862024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26872024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
26882024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
26892024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26902024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
26912024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26922024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
26932024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
26942024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
26952024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26962024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
26972024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
26982024-12-21T07:48:00.665ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
26992024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
27002024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
27012024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
27022024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27032024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
27042024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
27052024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
27062024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
27072024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27082024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27092024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
27102024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
27112024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
27122024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27132024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
27142024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
27152024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
27162024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
27172024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27182024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
27192024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
27202024-12-21T07:48:00.665ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:38:00.665252284 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
27212024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27222024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
27232024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27242024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27252024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
27262024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27272024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
27282024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27292024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
27302024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27312024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27322024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27332024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27342024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27352024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27362024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
27372024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27382024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27392024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27402024-12-21T07:48:00.665ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bfae345-1659-4377-bca9-c55abec2aeb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7c426166-4f75-4a87-b9ac-c0d590aea49b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1214, tv_nsec: 366191387 } })
27412024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27422024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27432024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
27442024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27452024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
27462024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27472024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
27482024-12-21T07:48:00.665ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dd95bbd-e009-486c-8c96-451a6e195a49.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1214, tv_nsec: 366293148 } })
27492024-12-21T07:48:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27502024-12-21T07:48:00.666ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
27512024-12-21T07:48:00.666ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.017706ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
27522024-12-21T07:48:00.666ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
27532024-12-21T07:48:00.666ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.462904ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
27542024-12-21T07:48:00.667ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27552024-12-21T07:48:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27562024-12-21T07:48:00.668ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27572024-12-21T07:48:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.750402ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27582024-12-21T07:48:00.668ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27592024-12-21T07:48:00.669ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27602024-12-21T07:48:00.669ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27612024-12-21T07:48:00.669ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.378033ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
27622024-12-21T07:48:00.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27632024-12-21T07:48:00.669ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27642024-12-21T07:48:00.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27652024-12-21T07:48:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27662024-12-21T07:48:00.671ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27672024-12-21T07:48:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27682024-12-21T07:48:00.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27692024-12-21T07:48:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27702024-12-21T07:48:00.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27712024-12-21T07:48:00.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27722024-12-21T07:48:00.681ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27732024-12-21T07:48:00.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27742024-12-21T07:48:00.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27752024-12-21T07:48:00.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27762024-12-21T07:48:00.688ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1214, tv_nsec: 388571469 } })
27772024-12-21T07:48:00.688ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
27782024-12-21T07:48:00.690ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1214, tv_nsec: 391449637 } })
27792024-12-21T07:48:00.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
27802024-12-21T07:48:00.691ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:38:00.665252284 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
27812024-12-21T07:48:00.691ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 26.246326ms iteration = 6 status = {"expiration":"2024-12-21T07:38:00.665252284Z","pruned":[]}
27822024-12-21T07:48:00.691ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27832024-12-21T07:48:00.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27842024-12-21T07:48:00.692ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27852024-12-21T07:48:00.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27862024-12-21T07:48:00.695ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1214, tv_nsec: 395415173 } })
27872024-12-21T07:48:00.695ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 29.793196ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27882024-12-21T07:48:00.695ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
27892024-12-21T07:48:00.700ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27902024-12-21T07:48:00.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27912024-12-21T07:48:00.711ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27922024-12-21T07:48:00.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27932024-12-21T07:48:00.713ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27942024-12-21T07:48:00.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27952024-12-21T07:48:00.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27962024-12-21T07:48:00.716ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27972024-12-21T07:48:00.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27982024-12-21T07:48:00.716ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27992024-12-21T07:48:00.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28002024-12-21T07:48:00.717ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.408442ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
28012024-12-21T07:48:00.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28022024-12-21T07:48:00.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28032024-12-21T07:48:00.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28042024-12-21T07:48:00.720ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28052024-12-21T07:48:00.720ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.847839ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28062024-12-21T07:48:00.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28072024-12-21T07:48:00.721ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28082024-12-21T07:48:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28092024-12-21T07:48:00.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28102024-12-21T07:48:00.723ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28112024-12-21T07:48:00.723ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28122024-12-21T07:48:00.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
28132024-12-21T07:48:00.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28142024-12-21T07:48:00.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28152024-12-21T07:48:00.726ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
28162024-12-21T07:48:00.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28172024-12-21T07:48:00.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28182024-12-21T07:48:00.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
28192024-12-21T07:48:00.727ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
28202024-12-21T07:48:00.727ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28212024-12-21T07:48:00.727ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28222024-12-21T07:48:00.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28232024-12-21T07:48:00.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
28242024-12-21T07:48:00.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.618012ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
28252024-12-21T07:48:00.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28262024-12-21T07:48:00.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28272024-12-21T07:48:00.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 63.69328ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28282024-12-21T07:48:00.729ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28292024-12-21T07:48:00.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28302024-12-21T07:48:00.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
28312024-12-21T07:48:00.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28322024-12-21T07:48:00.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28332024-12-21T07:48:00.734ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28342024-12-21T07:48:00.734ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28352024-12-21T07:48:00.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28362024-12-21T07:48:00.736ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
28372024-12-21T07:48:00.736ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
28382024-12-21T07:48:00.736ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 71.123354ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
28392024-12-21T07:48:00.737ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28402024-12-21T07:48:00.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
28412024-12-21T07:48:00.738ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28422024-12-21T07:48:00.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28432024-12-21T07:48:00.738ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28442024-12-21T07:48:00.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
28452024-12-21T07:48:00.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28462024-12-21T07:48:00.742ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28472024-12-21T07:48:00.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28482024-12-21T07:48:00.747ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28492024-12-21T07:48:00.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28502024-12-21T07:48:00.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28512024-12-21T07:48:00.748ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
28522024-12-21T07:48:00.748ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.766943ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
28532024-12-21T07:48:00.749ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28542024-12-21T07:48:00.751ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28552024-12-21T07:48:00.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28562024-12-21T07:48:00.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28572024-12-21T07:48:00.753ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28582024-12-21T07:48:00.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28592024-12-21T07:48:00.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28602024-12-21T07:48:00.755ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
28612024-12-21T07:48:00.755ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
28622024-12-21T07:48:00.755ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
28632024-12-21T07:48:00.755ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28642024-12-21T07:48:00.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28652024-12-21T07:48:00.757ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28662024-12-21T07:48:00.757ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28672024-12-21T07:48:00.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28682024-12-21T07:48:00.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28692024-12-21T07:48:00.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28702024-12-21T07:48:00.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
28712024-12-21T07:48:00.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
28722024-12-21T07:48:00.760ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28732024-12-21T07:48:00.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28742024-12-21T07:48:00.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28752024-12-21T07:48:00.761ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28762024-12-21T07:48:00.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28772024-12-21T07:48:00.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
28782024-12-21T07:48:00.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28792024-12-21T07:48:00.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28802024-12-21T07:48:00.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28812024-12-21T07:48:00.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28822024-12-21T07:48:00.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28832024-12-21T07:48:00.766ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28842024-12-21T07:48:00.766ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 101.317566ms iteration = 11 status = 0
28852024-12-21T07:48:00.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
28862024-12-21T07:48:00.770ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28872024-12-21T07:48:00.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28882024-12-21T07:48:00.772ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28892024-12-21T07:48:00.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28902024-12-21T07:48:00.773ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28912024-12-21T07:48:00.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28922024-12-21T07:48:00.774ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28932024-12-21T07:48:00.774ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
28942024-12-21T07:48:00.774ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
28952024-12-21T07:48:00.774ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 109.573083ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
28962024-12-21T07:48:00.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28972024-12-21T07:48:00.775ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
28982024-12-21T07:48:00.775ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 110.334756ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
28992024-12-21T07:48:00.775ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29002024-12-21T07:48:00.776ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29012024-12-21T07:48:00.776ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
29022024-12-21T07:48:00.776ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 111.352572ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
29032024-12-21T07:48:00.778ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29042024-12-21T07:48:00.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29052024-12-21T07:48:00.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
29062024-12-21T07:48:00.778ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29072024-12-21T07:48:00.778ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
29082024-12-21T07:48:00.778ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
29092024-12-21T07:48:00.778ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
29102024-12-21T07:48:00.778ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29112024-12-21T07:48:00.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29122024-12-21T07:48:00.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29132024-12-21T07:48:00.783ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
29142024-12-21T07:48:00.795ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 130.259028ms iteration = 14 status = {"physical_disks_added":0}
29152024-12-21T07:48:00.818ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
29162024-12-21T07:48:00.818ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 0 version = 2
29172024-12-21T07:48:00.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29182024-12-21T07:48:00.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29192024-12-21T07:48:00.829ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29202024-12-21T07:48:00.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29212024-12-21T07:48:00.829ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
29222024-12-21T07:48:00.861ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
29232024-12-21T07:48:00.861ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29242024-12-21T07:48:00.862ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "15a00db6-9e75-426c-962d-0b2c12e5557b", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:00 GMT"} })
29252024-12-21T07:48:00.862ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29262024-12-21T07:48:00.862ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
29272024-12-21T07:48:00.862ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29282024-12-21T07:48:00.862ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "159a2959-96bc-4571-9700-aaa038981cc8", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:00 GMT"} })
29292024-12-21T07:48:00.862ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29302024-12-21T07:48:00.863ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
29312024-12-21T07:48:00.864ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29322024-12-21T07:48:00.873ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
29332024-12-21T07:48:00.873ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 208.319217ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
29342024-12-21T07:48:00.879ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
29352024-12-21T07:48:00.879ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29362024-12-21T07:48:00.879ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "72ad589c-1a51-4487-b22a-f642c18e69ae", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:00 GMT"} })
29372024-12-21T07:48:00.879ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29382024-12-21T07:48:00.881ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29392024-12-21T07:48:00.952ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
29402024-12-21T07:48:00.952ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29412024-12-21T07:48:00.953ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "80c97eba-b460-4cf5-8ecf-9ad99ee4945e", "content-length": "372", "date": "Sat, 21 Dec 2024 07:48:00 GMT"} })
29422024-12-21T07:48:00.953ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29432024-12-21T07:48:00.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29442024-12-21T07:48:00.955ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29452024-12-21T07:48:00.956ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29462024-12-21T07:48:00.957ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29472024-12-21T07:48:00.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29482024-12-21T07:48:00.958ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
29492024-12-21T07:48:00.958ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29502024-12-21T07:48:00.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29512024-12-21T07:48:00.958ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29522024-12-21T07:48:00.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29532024-12-21T07:48:00.959ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
29542024-12-21T07:48:00.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
29552024-12-21T07:48:00.961ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29562024-12-21T07:48:00.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29572024-12-21T07:48:00.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29582024-12-21T07:48:00.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29592024-12-21T07:48:00.969ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 1 version = 2
29602024-12-21T07:48:00.969ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
29612024-12-21T07:48:00.969ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:43:41.075205 UTC dns_group = external generation = 2
29622024-12-21T07:48:00.969ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 304.310224ms iteration = 7 status = {"generation":2}
29632024-12-21T07:48:00.970ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29642024-12-21T07:48:00.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29652024-12-21T07:48:00.973ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29662024-12-21T07:48:00.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29672024-12-21T07:48:00.991ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 326.153567ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
29682024-12-21T07:48:00.996ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29692024-12-21T07:48:00.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
29702024-12-21T07:48:00.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29712024-12-21T07:48:00.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29722024-12-21T07:48:01.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29732024-12-21T07:48:01.004ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
29742024-12-21T07:48:01.004ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29752024-12-21T07:48:01.004ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29762024-12-21T07:48:01.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29772024-12-21T07:48:01.004ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "96510b12-a185-487d-b18f-91bb22f89bda", "date": "Sat, 21 Dec 2024 07:48:00 GMT"} })
29782024-12-21T07:48:01.004ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29792024-12-21T07:48:01.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29802024-12-21T07:48:01.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29812024-12-21T07:48:01.010ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:42:50.264108Z, time_modified: 2024-12-21T07:42:50.264108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }) }
29822024-12-21T07:48:01.010ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 345.143343ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]}},"default_endpoint":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
29832024-12-21T07:48:01.011ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29842024-12-21T07:48:01.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29852024-12-21T07:48:01.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29862024-12-21T07:48:01.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29872024-12-21T07:48:01.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29882024-12-21T07:48:01.015ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29892024-12-21T07:48:01.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29902024-12-21T07:48:01.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29912024-12-21T07:48:01.017ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
29922024-12-21T07:48:01.017ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3df81e5b-5bfb-4634-8c2f-b217ffcf1b27", "date": "Sat, 21 Dec 2024 07:48:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29932024-12-21T07:48:01.017ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29942024-12-21T07:48:01.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29952024-12-21T07:48:01.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29962024-12-21T07:48:01.019ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5a86aca1-9348-4472-90f5-3983f33d4a4e", "date": "Sat, 21 Dec 2024 07:48:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29972024-12-21T07:48:01.019ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29982024-12-21T07:48:01.021ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29992024-12-21T07:48:01.021ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 356.826927ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
30002024-12-21T07:48:01.022ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
30012024-12-21T07:48:01.022ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30022024-12-21T07:48:01.022ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5ad0aa37-36d7-4008-8f0a-df6ba2241d3a", "date": "Sat, 21 Dec 2024 07:48:00 GMT"} })
30032024-12-21T07:48:01.023ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
30042024-12-21T07:48:01.023ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d684a758-b4cb-454e-ba0f-47b6b7595c62", "content-length": "1", "date": "Sat, 21 Dec 2024 07:48:00 GMT"} })
30052024-12-21T07:48:01.026ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 361.421254ms iteration = 12 status = {}
30062024-12-21T07:48:01.027ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30072024-12-21T07:48:01.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30082024-12-21T07:48:01.030ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 365.4027ms iteration = 11 status = null
30092024-12-21T07:48:01.044ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
30102024-12-21T07:48:01.044ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
30112024-12-21T07:48:01.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30122024-12-21T07:48:01.044ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 379.649897ms iteration = 11 status = {}
30132024-12-21T07:48:01.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30142024-12-21T07:48:01.051ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30152024-12-21T07:48:01.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30162024-12-21T07:48:01.073ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
30172024-12-21T07:48:01.074ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "238a985c-f7df-4f72-bef8-9652e0a5108d", "date": "Sat, 21 Dec 2024 07:48:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
30182024-12-21T07:48:01.074ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
30192024-12-21T07:48:01.076ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8262b6b1-7351-48e3-b061-a1ad9d6617c4", "date": "Sat, 21 Dec 2024 07:48:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
30202024-12-21T07:48:01.076ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
30212024-12-21T07:48:01.077ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30222024-12-21T07:48:01.078ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8993aa5b-5b7d-4ca1-bb73-4ddf8c843538", "date": "Sat, 21 Dec 2024 07:48:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
30232024-12-21T07:48:01.078ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
30242024-12-21T07:48:01.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30252024-12-21T07:48:01.081ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30262024-12-21T07:48:01.081ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
30272024-12-21T07:48:01.081ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 416.165544ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
30282024-12-21T07:48:01.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30292024-12-21T07:48:01.084ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
30302024-12-21T07:48:01.084ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
30312024-12-21T07:48:01.084ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:43:39.444085 UTC dns_group = internal generation = 1
30322024-12-21T07:48:01.084ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 419.444359ms iteration = 7 status = {"generation":1}
30332024-12-21T07:48:01.085ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30342024-12-21T07:48:01.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
30352024-12-21T07:48:01.088ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30362024-12-21T07:48:01.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30372024-12-21T07:48:01.146ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30382024-12-21T07:48:01.147ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "576a3503-1dff-4dce-82c1-9b9ba6d09986", "content-length": "691", "date": "Sat, 21 Dec 2024 07:48:00 GMT"} })
30392024-12-21T07:48:01.147ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
30402024-12-21T07:48:01.147ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
30412024-12-21T07:48:01.147ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
30422024-12-21T07:48:01.149ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 484.460961ms iteration = 11 status = {}
30432024-12-21T07:48:01.149ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30442024-12-21T07:48:01.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30452024-12-21T07:48:01.152ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30462024-12-21T07:48:01.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30472024-12-21T07:48:01.153ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30482024-12-21T07:48:01.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30492024-12-21T07:48:01.154ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30502024-12-21T07:48:01.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30512024-12-21T07:48:01.155ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
30522024-12-21T07:48:01.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30532024-12-21T07:48:01.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30542024-12-21T07:48:01.157ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30552024-12-21T07:48:01.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30562024-12-21T07:48:01.158ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30572024-12-21T07:48:01.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30582024-12-21T07:48:01.160ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30592024-12-21T07:48:01.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30602024-12-21T07:48:01.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30612024-12-21T07:48:01.165ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
30622024-12-21T07:48:01.165ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
30632024-12-21T07:48:01.165ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30642024-12-21T07:48:01.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30652024-12-21T07:48:01.165ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b804cc1-1215-4987-8305-45eb461abebf", "content-length": "134", "date": "Sat, 21 Dec 2024 07:48:01 GMT"} })
30662024-12-21T07:48:01.165ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
30672024-12-21T07:48:01.165ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
30682024-12-21T07:48:01.165ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
30692024-12-21T07:48:01.165ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30702024-12-21T07:48:01.165ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30712024-12-21T07:48:01.165ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30722024-12-21T07:48:01.165ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30732024-12-21T07:48:01.165ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30742024-12-21T07:48:01.166ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30752024-12-21T07:48:01.166ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30762024-12-21T07:48:01.166ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
30772024-12-21T07:48:01.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30782024-12-21T07:48:01.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30792024-12-21T07:48:01.167ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
30802024-12-21T07:48:01.167ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e41a4c47-2a4e-42aa-b4ff-fffa165b50d3", "content-length": "2", "date": "Sat, 21 Dec 2024 07:48:01 GMT"} })
30812024-12-21T07:48:01.167ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
30822024-12-21T07:48:01.167ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9cfc1b4-8bac-4c80-bfe7-6b05b9552116", "content-length": "52", "date": "Sat, 21 Dec 2024 07:48:01 GMT"} })
30832024-12-21T07:48:01.167ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
30842024-12-21T07:48:01.167ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
30852024-12-21T07:48:01.200ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30862024-12-21T07:48:01.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30872024-12-21T07:48:01.202ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30882024-12-21T07:48:01.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30892024-12-21T07:48:01.204ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30902024-12-21T07:48:01.207ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
30912024-12-21T07:48:01.207ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30922024-12-21T07:48:01.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30932024-12-21T07:48:01.216ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30942024-12-21T07:48:01.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30952024-12-21T07:48:01.218ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30962024-12-21T07:48:01.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30972024-12-21T07:48:01.220ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30982024-12-21T07:48:01.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30992024-12-21T07:48:01.223ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31002024-12-21T07:48:01.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31012024-12-21T07:48:01.226ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31022024-12-21T07:48:01.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31032024-12-21T07:48:01.227ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31042024-12-21T07:48:01.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31052024-12-21T07:48:01.229ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31062024-12-21T07:48:01.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31072024-12-21T07:48:01.262ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31082024-12-21T07:48:01.266ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
31092024-12-21T07:48:01.266ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31102024-12-21T07:48:01.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31112024-12-21T07:48:01.267ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31122024-12-21T07:48:01.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31132024-12-21T07:48:01.268ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "83d817e1-7065-4d55-bc5e-b980e57c7f29", "date": "Sat, 21 Dec 2024 07:48:01 GMT"} })
31142024-12-21T07:48:01.268ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
31152024-12-21T07:48:01.268ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
31162024-12-21T07:48:01.268ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "16689c13-1e22-45bd-8648-5bc057557baa", "content-length": "682", "date": "Sat, 21 Dec 2024 07:48:01 GMT"} })
31172024-12-21T07:48:01.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31182024-12-21T07:48:01.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31192024-12-21T07:48:01.269ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31202024-12-21T07:48:01.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31212024-12-21T07:48:01.271ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31222024-12-21T07:48:01.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31232024-12-21T07:48:01.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31242024-12-21T07:48:01.275ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
31252024-12-21T07:48:01.275ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31262024-12-21T07:48:01.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31272024-12-21T07:48:01.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31282024-12-21T07:48:01.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31292024-12-21T07:48:01.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31302024-12-21T07:48:01.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31312024-12-21T07:48:01.283ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 1590b051-5b52-401c-b768-bbef4af00f89, kind: Service { id: bf6abf36-caab-412a-b734-038cee4a46b6 }, name: Name("nexus-bf6abf36-caab-412a-b734-038cee4a46b6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2a0ff22a-6a78-4cb0-b61d-38c999331844, kind: Service { id: e640ec59-1392-402a-8715-71c8bdc91537 }, name: Name("nexus-e640ec59-1392-402a-8715-71c8bdc91537"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 32])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd0592d1-5774-4ea2-8826-dec211cc7fec, kind: Service { id: a920b126-b55b-45c8-9984-5279bf662759 }, name: Name("nexus-a920b126-b55b-45c8-9984-5279bf662759"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 06368864-4b29-42bd-ae60-c6735712620d, kind: Service { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 }, name: Name("external-dns-b2ae004a-4c01-4dcf-8e90-49ba61c66084"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa85cda4-dfd2-46dc-aa66-9384e585dcaf, kind: Service { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 }, name: Name("external-dns-4dd95bbd-e009-486c-8c96-451a6e195a49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
31322024-12-21T07:48:01.283ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31332024-12-21T07:48:01.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31342024-12-21T07:48:01.284ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 619.910505ms iteration = 11 status = {}
31352024-12-21T07:48:01.285ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31362024-12-21T07:48:01.287ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
31372024-12-21T07:48:01.287ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31382024-12-21T07:48:01.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31392024-12-21T07:48:01.288ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
31402024-12-21T07:48:01.288ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 06368864-4b29-42bd-ae60-c6735712620d, kind: Service { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 }, name: Name("external-dns-b2ae004a-4c01-4dcf-8e90-49ba61c66084"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa85cda4-dfd2-46dc-aa66-9384e585dcaf, kind: Service { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 }, name: Name("external-dns-4dd95bbd-e009-486c-8c96-451a6e195a49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1590b051-5b52-401c-b768-bbef4af00f89, kind: Service { id: bf6abf36-caab-412a-b734-038cee4a46b6 }, name: Name("nexus-bf6abf36-caab-412a-b734-038cee4a46b6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2a0ff22a-6a78-4cb0-b61d-38c999331844, kind: Service { id: e640ec59-1392-402a-8715-71c8bdc91537 }, name: Name("nexus-e640ec59-1392-402a-8715-71c8bdc91537"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 32])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd0592d1-5774-4ea2-8826-dec211cc7fec, kind: Service { id: a920b126-b55b-45c8-9984-5279bf662759 }, name: Name("nexus-a920b126-b55b-45c8-9984-5279bf662759"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
31412024-12-21T07:48:01.288ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
31422024-12-21T07:48:01.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0a8705d1-04a3-4ed1-b01d-74171bc591d4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31432024-12-21T07:48:01.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0a8705d1-04a3-4ed1-b01d-74171bc591d4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31442024-12-21T07:48:01.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0a8705d1-04a3-4ed1-b01d-74171bc591d4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31452024-12-21T07:48:01.399ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, time_created: 2024-12-21T07:43:34.995625Z, time_modified: 2024-12-21T07:43:34.995625Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
31462024-12-21T07:48:01.399ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
31472024-12-21T07:48:01.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31482024-12-21T07:48:01.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31492024-12-21T07:48:01.402ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31502024-12-21T07:48:01.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31512024-12-21T07:48:01.404ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31522024-12-21T07:48:01.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
31532024-12-21T07:48:01.436ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
31542024-12-21T07:48:01.437ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "7c94113e-cffe-4937-9187-64926c05f14e", "date": "Sat, 21 Dec 2024 07:48:01 GMT"} })
31552024-12-21T07:48:01.438ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
31562024-12-21T07:48:01.438ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 773.323287ms
31572024-12-21T07:48:01.438ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 773.337387ms iteration = 2 status = {}
31582024-12-21T07:48:02.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fc140c66-ab6e-4e41-b306-65efa5b56468 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31592024-12-21T07:48:02.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fc140c66-ab6e-4e41-b306-65efa5b56468 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31602024-12-21T07:48:02.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fc140c66-ab6e-4e41-b306-65efa5b56468 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31612024-12-21T07:48:03.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 832e7680-982f-4eb1-b586-a97a38804bf7 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31622024-12-21T07:48:03.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 832e7680-982f-4eb1-b586-a97a38804bf7 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31632024-12-21T07:48:03.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 832e7680-982f-4eb1-b586-a97a38804bf7 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31642024-12-21T07:48:04.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8a9771e-4234-4364-9ec8-1d6895f99cd8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31652024-12-21T07:48:04.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8a9771e-4234-4364-9ec8-1d6895f99cd8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31662024-12-21T07:48:04.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8a9771e-4234-4364-9ec8-1d6895f99cd8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31672024-12-21T07:48:05.015ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:43523
31682024-12-21T07:48:05.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43523 req_id = 533ac549-e6e3-4a7d-8d3d-424eae06baf4 roles = RoleSet { roles: {} } uri = /metrics/producers
31692024-12-21T07:48:05.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43523 req_id = 533ac549-e6e3-4a7d-8d3d-424eae06baf4 resource = Database result = Ok(()) uri = /metrics/producers
31702024-12-21T07:48:05.062ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = e2e45dd6-1479-4aab-8030-3bcab95a4f4b
31712024-12-21T07:48:05.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46757 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43523 req_id = 533ac549-e6e3-4a7d-8d3d-424eae06baf4 response_code = 201 uri = /metrics/producers
31722024-12-21T07:48:05.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 93f25817-5931-443e-9eff-4b300b90c14e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31732024-12-21T07:48:05.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 93f25817-5931-443e-9eff-4b300b90c14e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31742024-12-21T07:48:05.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 93f25817-5931-443e-9eff-4b300b90c14e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31752024-12-21T07:48:06.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 38685e65-2824-4984-a774-02180acb2f3d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31762024-12-21T07:48:06.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 38685e65-2824-4984-a774-02180acb2f3d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31772024-12-21T07:48:06.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 38685e65-2824-4984-a774-02180acb2f3d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31782024-12-21T07:48:07.101ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:64108
31792024-12-21T07:48:07.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64108 req_id = aec6c324-8256-4709-bbfe-52ea77a2bc03 roles = RoleSet { roles: {} } uri = /metrics/producers
31802024-12-21T07:48:07.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64108 req_id = aec6c324-8256-4709-bbfe-52ea77a2bc03 resource = Database result = Ok(()) uri = /metrics/producers
31812024-12-21T07:48:07.138ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 5032d219-f3bf-40f5-8e36-efba904d39be
31822024-12-21T07:48:07.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36800 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64108 req_id = aec6c324-8256-4709-bbfe-52ea77a2bc03 response_code = 201 uri = /metrics/producers
31832024-12-21T07:48:07.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 482df01c-bb88-4b3f-88e9-14f6b3d9a42a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31842024-12-21T07:48:07.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 482df01c-bb88-4b3f-88e9-14f6b3d9a42a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31852024-12-21T07:48:07.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 482df01c-bb88-4b3f-88e9-14f6b3d9a42a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31862024-12-21T07:48:08.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7fbd3a6e-27ac-4659-b00a-1c790731cf6d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31872024-12-21T07:48:08.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7fbd3a6e-27ac-4659-b00a-1c790731cf6d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31882024-12-21T07:48:08.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2581 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7fbd3a6e-27ac-4659-b00a-1c790731cf6d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31892024-12-21T07:48:09.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 51d72887-b666-4eb6-9f53-8b4117a90e82 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31902024-12-21T07:48:09.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 51d72887-b666-4eb6-9f53-8b4117a90e82 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31912024-12-21T07:48:09.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 51d72887-b666-4eb6-9f53-8b4117a90e82 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31922024-12-21T07:48:09.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1392 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 83ca8b8b-0b27-425c-8a75-f7067a2e4db8 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
31932024-12-21T07:48:10.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d5c6d638-d49c-4e2d-9b72-247f84bcf527 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31942024-12-21T07:48:10.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d5c6d638-d49c-4e2d-9b72-247f84bcf527 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31952024-12-21T07:48:10.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d5c6d638-d49c-4e2d-9b72-247f84bcf527 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
31962024-12-21T07:48:10.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
31972024-12-21T07:48:10.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
31982024-12-21T07:48:10.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31992024-12-21T07:48:10.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32002024-12-21T07:48:10.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32012024-12-21T07:48:10.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32022024-12-21T07:48:10.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32032024-12-21T07:48:10.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32042024-12-21T07:48:10.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32052024-12-21T07:48:10.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32062024-12-21T07:48:10.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32072024-12-21T07:48:10.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32082024-12-21T07:48:10.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32092024-12-21T07:48:10.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
32102024-12-21T07:48:10.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32112024-12-21T07:48:10.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32122024-12-21T07:48:10.688ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
32132024-12-21T07:48:10.688ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.705075ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
32142024-12-21T07:48:10.698ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32152024-12-21T07:48:10.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32162024-12-21T07:48:10.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.676459ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32172024-12-21T07:48:11.492ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:40977
32182024-12-21T07:48:11.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40977 req_id = c3b28957-aa92-42d4-a419-6925d9b9a990 roles = RoleSet { roles: {} } uri = /metrics/producers
32192024-12-21T07:48:11.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40977 req_id = c3b28957-aa92-42d4-a419-6925d9b9a990 resource = Database result = Ok(()) uri = /metrics/producers
32202024-12-21T07:48:11.527ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 5518d5c2-1f45-4e85-8fb9-41e1149133a1
32212024-12-21T07:48:11.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35239 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40977 req_id = c3b28957-aa92-42d4-a419-6925d9b9a990 response_code = 201 uri = /metrics/producers
32222024-12-21T07:48:11.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4161f1ec-05dd-4fee-9bf0-c712666e2893 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32232024-12-21T07:48:11.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4161f1ec-05dd-4fee-9bf0-c712666e2893 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32242024-12-21T07:48:11.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4161f1ec-05dd-4fee-9bf0-c712666e2893 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32252024-12-21T07:48:12.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a2b9d81d-e8ba-45fe-83cf-7120b39b92a4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32262024-12-21T07:48:12.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a2b9d81d-e8ba-45fe-83cf-7120b39b92a4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32272024-12-21T07:48:12.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a2b9d81d-e8ba-45fe-83cf-7120b39b92a4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32282024-12-21T07:48:13.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f41dcfd6-6487-4bc5-afaf-d3bcbf0bfc2f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32292024-12-21T07:48:13.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f41dcfd6-6487-4bc5-afaf-d3bcbf0bfc2f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32302024-12-21T07:48:13.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f41dcfd6-6487-4bc5-afaf-d3bcbf0bfc2f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32312024-12-21T07:48:14.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fbfc80ce-2c0a-4510-9ed8-91ba3c0524c6 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32322024-12-21T07:48:14.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fbfc80ce-2c0a-4510-9ed8-91ba3c0524c6 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32332024-12-21T07:48:14.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fbfc80ce-2c0a-4510-9ed8-91ba3c0524c6 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32342024-12-21T07:48:15.139ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:48421
32352024-12-21T07:48:15.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48421 req_id = 385462c2-6f9a-4774-b1d8-558f71be58cf roles = RoleSet { roles: {} } uri = /metrics/producers
32362024-12-21T07:48:15.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48421 req_id = 385462c2-6f9a-4774-b1d8-558f71be58cf resource = Database result = Ok(()) uri = /metrics/producers
32372024-12-21T07:48:15.150ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 54344af8-3e4f-4625-a3a8-19b1290c40fc
32382024-12-21T07:48:15.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10933 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48421 req_id = 385462c2-6f9a-4774-b1d8-558f71be58cf response_code = 201 uri = /metrics/producers
32392024-12-21T07:48:15.323ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:35051
32402024-12-21T07:48:15.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35051 req_id = 6316d7a8-f9bc-446b-bc79-6f4b016b0be1 roles = RoleSet { roles: {} } uri = /metrics/producers
32412024-12-21T07:48:15.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35051 req_id = 6316d7a8-f9bc-446b-bc79-6f4b016b0be1 resource = Database result = Ok(()) uri = /metrics/producers
32422024-12-21T07:48:15.333ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 9c233aaf-fd1f-4081-b1ff-c3b56dd02b1b
32432024-12-21T07:48:15.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10576 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35051 req_id = 6316d7a8-f9bc-446b-bc79-6f4b016b0be1 response_code = 201 uri = /metrics/producers
32442024-12-21T07:48:15.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 28a9aa19-be88-4678-b9a5-8f18bc385c25 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32452024-12-21T07:48:15.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 28a9aa19-be88-4678-b9a5-8f18bc385c25 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32462024-12-21T07:48:15.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 28a9aa19-be88-4678-b9a5-8f18bc385c25 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32472024-12-21T07:48:16.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 102fb8fb-d21d-44a3-80be-e7ae8724b3fb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32482024-12-21T07:48:16.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 102fb8fb-d21d-44a3-80be-e7ae8724b3fb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32492024-12-21T07:48:16.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 102fb8fb-d21d-44a3-80be-e7ae8724b3fb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32502024-12-21T07:48:17.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e73e7362-a323-4540-a049-93e8c590780f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32512024-12-21T07:48:17.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e73e7362-a323-4540-a049-93e8c590780f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32522024-12-21T07:48:17.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2922 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e73e7362-a323-4540-a049-93e8c590780f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32532024-12-21T07:48:18.261ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:46782
32542024-12-21T07:48:18.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46782 req_id = fae33ad3-8473-46d7-8ca3-b3d99f7d9017 roles = RoleSet { roles: {} } uri = /metrics/producers
32552024-12-21T07:48:18.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46782 req_id = fae33ad3-8473-46d7-8ca3-b3d99f7d9017 resource = Database result = Ok(()) uri = /metrics/producers
32562024-12-21T07:48:18.271ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32572024-12-21T07:48:18.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10061 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46782 req_id = fae33ad3-8473-46d7-8ca3-b3d99f7d9017 response_code = 201 uri = /metrics/producers
32582024-12-21T07:48:18.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 169859be-fec5-40ad-9fd1-ba89504b290d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32592024-12-21T07:48:18.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 169859be-fec5-40ad-9fd1-ba89504b290d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32602024-12-21T07:48:18.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 169859be-fec5-40ad-9fd1-ba89504b290d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32612024-12-21T07:48:19.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1386 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 848ea0a6-cedd-4bf5-8859-5619b3f3cb8b response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
32622024-12-21T07:48:19.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 71fd6efc-cefd-42c8-9989-403473be3f8e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32632024-12-21T07:48:19.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 71fd6efc-cefd-42c8-9989-403473be3f8e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32642024-12-21T07:48:19.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 71fd6efc-cefd-42c8-9989-403473be3f8e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32652024-12-21T07:48:20.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
32662024-12-21T07:48:20.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32672024-12-21T07:48:20.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
32682024-12-21T07:48:20.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32692024-12-21T07:48:20.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32702024-12-21T07:48:20.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32712024-12-21T07:48:20.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32722024-12-21T07:48:20.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32732024-12-21T07:48:20.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32742024-12-21T07:48:20.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32752024-12-21T07:48:20.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32762024-12-21T07:48:20.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32772024-12-21T07:48:20.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32782024-12-21T07:48:20.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
32792024-12-21T07:48:20.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32802024-12-21T07:48:20.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32812024-12-21T07:48:20.688ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
32822024-12-21T07:48:20.688ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.983513ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
32832024-12-21T07:48:20.692ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32842024-12-21T07:48:20.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32852024-12-21T07:48:20.725ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.586308ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32862024-12-21T07:48:20.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ef5ccbde-41f3-464c-9d70-670925e9fd50 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32872024-12-21T07:48:20.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ef5ccbde-41f3-464c-9d70-670925e9fd50 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32882024-12-21T07:48:20.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ef5ccbde-41f3-464c-9d70-670925e9fd50 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32892024-12-21T07:48:21.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 26bbe944-c47c-4414-9ad5-4ed981aaf1c9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32902024-12-21T07:48:21.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 26bbe944-c47c-4414-9ad5-4ed981aaf1c9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32912024-12-21T07:48:21.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 26bbe944-c47c-4414-9ad5-4ed981aaf1c9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32922024-12-21T07:48:22.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 53b40223-6f6e-4c58-8655-a2d6ca4917d7 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32932024-12-21T07:48:22.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 53b40223-6f6e-4c58-8655-a2d6ca4917d7 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32942024-12-21T07:48:22.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 53b40223-6f6e-4c58-8655-a2d6ca4917d7 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32952024-12-21T07:48:23.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 56542a29-c4ce-44bd-8083-9cad3d3ea2e8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32962024-12-21T07:48:23.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 56542a29-c4ce-44bd-8083-9cad3d3ea2e8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32972024-12-21T07:48:23.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 56542a29-c4ce-44bd-8083-9cad3d3ea2e8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32982024-12-21T07:48:24.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 275374f8-e2bf-4cd6-a410-484270ac8e8d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
32992024-12-21T07:48:24.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 275374f8-e2bf-4cd6-a410-484270ac8e8d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
33002024-12-21T07:48:24.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 275374f8-e2bf-4cd6-a410-484270ac8e8d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
33012024-12-21T07:48:25.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 226dd0b9-5972-45d1-a063-6f72f2816612 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
33022024-12-21T07:48:25.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 226dd0b9-5972-45d1-a063-6f72f2816612 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
33032024-12-21T07:48:25.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 226dd0b9-5972-45d1-a063-6f72f2816612 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
33042024-12-21T07:48:26.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 855c3f83-d539-4c35-a43a-643e1e3674fc roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
33052024-12-21T07:48:26.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 855c3f83-d539-4c35-a43a-643e1e3674fc resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
33062024-12-21T07:48:26.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1637 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 855c3f83-d539-4c35-a43a-643e1e3674fc response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
33072024-12-21T07:48:27.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f7e727f7-8322-43c2-be39-4f1b5d9a3e9a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
33082024-12-21T07:48:27.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f7e727f7-8322-43c2-be39-4f1b5d9a3e9a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
33092024-12-21T07:48:27.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1882 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f7e727f7-8322-43c2-be39-4f1b5d9a3e9a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
33102024-12-21T07:48:28.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = da22687b-91b7-4f57-a020-199f0000cf1b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
33112024-12-21T07:48:28.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = da22687b-91b7-4f57-a020-199f0000cf1b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
33122024-12-21T07:48:28.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1897 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = da22687b-91b7-4f57-a020-199f0000cf1b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
33132024-12-21T07:48:29.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1318 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = db66fae7-8769-4dae-b047-5e12c083d635 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
33142024-12-21T07:48:29.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 97e1f6ac-4a60-46f3-8f9f-31f93a03f5e9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
33152024-12-21T07:48:29.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 97e1f6ac-4a60-46f3-8f9f-31f93a03f5e9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
33162024-12-21T07:48:29.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 97e1f6ac-4a60-46f3-8f9f-31f93a03f5e9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
33172024-12-21T07:48:30.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 282c2ad8-9496-40f6-a71b-80f260b5f815 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
33182024-12-21T07:48:30.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 282c2ad8-9496-40f6-a71b-80f260b5f815 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
33192024-12-21T07:48:30.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 282c2ad8-9496-40f6-a71b-80f260b5f815 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
33202024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
33212024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
33222024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33232024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
33242024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33252024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33262024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33272024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
33282024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33292024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
33302024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
33312024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33322024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33332024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
33342024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
33352024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
33362024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33372024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
33382024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33392024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
33402024-12-21T07:48:30.665ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
33412024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33422024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
33432024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33442024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
33452024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33462024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
33472024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33482024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
33492024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
33502024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33512024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33522024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
33532024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
33542024-12-21T07:48:30.665ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
33552024-12-21T07:48:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33562024-12-21T07:48:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33572024-12-21T07:48:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33582024-12-21T07:48:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33592024-12-21T07:48:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33602024-12-21T07:48:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33612024-12-21T07:48:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33622024-12-21T07:48:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33632024-12-21T07:48:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33642024-12-21T07:48:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33652024-12-21T07:48:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33662024-12-21T07:48:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33672024-12-21T07:48:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33682024-12-21T07:48:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
33692024-12-21T07:48:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
33702024-12-21T07:48:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33712024-12-21T07:48:30.669ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1244, tv_nsec: 370077592 } })
33722024-12-21T07:48:30.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33732024-12-21T07:48:30.669ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.962156ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33742024-12-21T07:48:30.669ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
33752024-12-21T07:48:30.671ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33762024-12-21T07:48:30.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33772024-12-21T07:48:30.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33782024-12-21T07:48:30.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33792024-12-21T07:48:30.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33802024-12-21T07:48:30.672ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33812024-12-21T07:48:30.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
33822024-12-21T07:48:30.675ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33832024-12-21T07:48:30.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33842024-12-21T07:48:30.678ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33852024-12-21T07:48:30.680ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1244, tv_nsec: 380668819 } })
33862024-12-21T07:48:30.680ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
33872024-12-21T07:48:30.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33882024-12-21T07:48:30.680ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33892024-12-21T07:48:30.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33902024-12-21T07:48:30.683ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33912024-12-21T07:48:30.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33922024-12-21T07:48:30.684ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1244, tv_nsec: 384973680 } })
33932024-12-21T07:48:30.684ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
33942024-12-21T07:48:30.715ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33952024-12-21T07:48:30.716ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33962024-12-21T07:48:30.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33972024-12-21T07:48:30.716ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33982024-12-21T07:48:30.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33992024-12-21T07:48:30.717ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34002024-12-21T07:48:30.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34012024-12-21T07:48:30.718ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34022024-12-21T07:48:30.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34032024-12-21T07:48:30.718ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34042024-12-21T07:48:30.718ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34052024-12-21T07:48:30.718ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34062024-12-21T07:48:30.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34072024-12-21T07:48:30.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34082024-12-21T07:48:30.720ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34092024-12-21T07:48:30.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34102024-12-21T07:48:30.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34112024-12-21T07:48:30.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.618133ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34122024-12-21T07:48:30.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.654563ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
34132024-12-21T07:48:30.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34142024-12-21T07:48:30.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34152024-12-21T07:48:30.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34162024-12-21T07:48:30.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34172024-12-21T07:48:30.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34182024-12-21T07:48:30.724ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.544984ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
34192024-12-21T07:48:30.725ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34202024-12-21T07:48:30.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34212024-12-21T07:48:30.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34222024-12-21T07:48:30.727ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34232024-12-21T07:48:30.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34242024-12-21T07:48:30.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34252024-12-21T07:48:30.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34262024-12-21T07:48:30.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34272024-12-21T07:48:30.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.964008ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
34282024-12-21T07:48:30.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34292024-12-21T07:48:30.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34302024-12-21T07:48:30.734ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34312024-12-21T07:48:30.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34322024-12-21T07:48:30.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34332024-12-21T07:48:30.736ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
34342024-12-21T07:48:30.736ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34352024-12-21T07:48:30.736ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0cc216e3-9ee3-4ea5-9e6a-7a17881dc4c2", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:30 GMT"} })
34362024-12-21T07:48:30.736ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34372024-12-21T07:48:30.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
34382024-12-21T07:48:30.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34392024-12-21T07:48:30.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34402024-12-21T07:48:30.738ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34412024-12-21T07:48:30.746ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
34422024-12-21T07:48:30.746ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.216482ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
34432024-12-21T07:48:30.752ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34442024-12-21T07:48:30.752ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34452024-12-21T07:48:30.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34462024-12-21T07:48:30.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34472024-12-21T07:48:30.755ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34482024-12-21T07:48:30.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34492024-12-21T07:48:30.758ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 92.805745ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
34502024-12-21T07:48:30.759ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
34512024-12-21T07:48:30.759ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34522024-12-21T07:48:30.759ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "37e519f2-cd3b-4246-b648-aea4caf7996d", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:30 GMT"} })
34532024-12-21T07:48:30.759ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34542024-12-21T07:48:30.760ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34552024-12-21T07:48:30.760ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
34562024-12-21T07:48:30.760ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34572024-12-21T07:48:30.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34582024-12-21T07:48:30.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34592024-12-21T07:48:30.762ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
34602024-12-21T07:48:30.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
34612024-12-21T07:48:30.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34622024-12-21T07:48:30.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34632024-12-21T07:48:30.766ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 100.456792ms iteration = 12 status = 0
34642024-12-21T07:48:30.768ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 102.544806ms iteration = 15 status = {"physical_disks_added":0}
34652024-12-21T07:48:30.771ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
34662024-12-21T07:48:30.771ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 105.20778ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
34672024-12-21T07:48:30.788ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
34682024-12-21T07:48:30.788ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34692024-12-21T07:48:30.788ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "12ae5626-a60e-4e47-921e-ccd4550d0cb2", "content-length": "26", "date": "Sat, 21 Dec 2024 07:48:30 GMT"} })
34702024-12-21T07:48:30.788ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34712024-12-21T07:48:30.790ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34722024-12-21T07:48:30.792ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 126.325851ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
34732024-12-21T07:48:30.794ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34742024-12-21T07:48:30.794ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
34752024-12-21T07:48:30.794ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 128.867574ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
34762024-12-21T07:48:30.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34772024-12-21T07:48:30.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34782024-12-21T07:48:30.825ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
34792024-12-21T07:48:30.825ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb0bac76-6423-42bf-810a-c01bef6b3402", "content-length": "1", "date": "Sat, 21 Dec 2024 07:48:30 GMT"} })
34802024-12-21T07:48:30.827ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34812024-12-21T07:48:30.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34822024-12-21T07:48:30.830ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 164.322504ms iteration = 12 status = null
34832024-12-21T07:48:30.865ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34842024-12-21T07:48:30.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34852024-12-21T07:48:30.867ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34862024-12-21T07:48:30.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34872024-12-21T07:48:30.870ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34882024-12-21T07:48:30.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34892024-12-21T07:48:30.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34902024-12-21T07:48:30.874ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34912024-12-21T07:48:30.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34922024-12-21T07:48:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34932024-12-21T07:48:30.899ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 233.16045ms iteration = 12 status = {}
34942024-12-21T07:48:30.967ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
34952024-12-21T07:48:30.967ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34962024-12-21T07:48:30.968ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5534f7ee-d4ae-4106-9944-390e3e888471", "content-length": "372", "date": "Sat, 21 Dec 2024 07:48:30 GMT"} })
34972024-12-21T07:48:30.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34982024-12-21T07:48:30.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34992024-12-21T07:48:31.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b5a4e620-4549-4113-8dcd-dfd1fe7f1f69 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35002024-12-21T07:48:31.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b5a4e620-4549-4113-8dcd-dfd1fe7f1f69 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35012024-12-21T07:48:31.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b5a4e620-4549-4113-8dcd-dfd1fe7f1f69 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35022024-12-21T07:48:31.010ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
35032024-12-21T07:48:31.010ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
35042024-12-21T07:48:31.013ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d55abb7d-c498-48b4-bb92-26414b7c0fac", "date": "Sat, 21 Dec 2024 07:48:30 GMT"} })
35052024-12-21T07:48:31.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35062024-12-21T07:48:31.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35072024-12-21T07:48:31.014ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35082024-12-21T07:48:31.014ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "75100e53-83d2-4dc8-98bc-14a0ca1c8e79", "content-length": "691", "date": "Sat, 21 Dec 2024 07:48:30 GMT"} })
35092024-12-21T07:48:31.014ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
35102024-12-21T07:48:31.014ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
35112024-12-21T07:48:31.015ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
35122024-12-21T07:48:31.016ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35132024-12-21T07:48:31.016ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 350.678545ms iteration = 12 status = {}
35142024-12-21T07:48:31.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35152024-12-21T07:48:31.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35162024-12-21T07:48:31.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35172024-12-21T07:48:31.023ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
35182024-12-21T07:48:31.023ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35192024-12-21T07:48:31.024ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6a09eb19-8dfc-4ab7-be10-9d75d39e392e", "date": "Sat, 21 Dec 2024 07:48:30 GMT"} })
35202024-12-21T07:48:31.025ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 359.499772ms iteration = 13 status = {}
35212024-12-21T07:48:31.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35222024-12-21T07:48:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35232024-12-21T07:48:31.048ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
35242024-12-21T07:48:31.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35252024-12-21T07:48:31.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35262024-12-21T07:48:31.059ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35272024-12-21T07:48:31.059ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0e65219-976e-41fe-b874-2ef44dc3649c", "content-length": "134", "date": "Sat, 21 Dec 2024 07:48:30 GMT"} })
35282024-12-21T07:48:31.059ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
35292024-12-21T07:48:31.059ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
35302024-12-21T07:48:31.060ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
35312024-12-21T07:48:31.060ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35322024-12-21T07:48:31.060ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35332024-12-21T07:48:31.060ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35342024-12-21T07:48:31.060ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35352024-12-21T07:48:31.060ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35362024-12-21T07:48:31.060ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35372024-12-21T07:48:31.060ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35382024-12-21T07:48:31.060ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
35392024-12-21T07:48:31.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35402024-12-21T07:48:31.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35412024-12-21T07:48:31.062ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35422024-12-21T07:48:31.062ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5940fb56-5390-43a2-bc62-b9c1acfd75f1", "content-length": "2", "date": "Sat, 21 Dec 2024 07:48:30 GMT"} })
35432024-12-21T07:48:31.062ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35442024-12-21T07:48:31.062ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea0dcb9b-8763-43ac-b00e-5819bb4e545e", "content-length": "52", "date": "Sat, 21 Dec 2024 07:48:30 GMT"} })
35452024-12-21T07:48:31.062ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
35462024-12-21T07:48:31.062ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35472024-12-21T07:48:31.160ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "514a43c6-581e-439d-a8bb-0da22514c8af", "date": "Sat, 21 Dec 2024 07:48:30 GMT"} })
35482024-12-21T07:48:31.160ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
35492024-12-21T07:48:31.160ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35502024-12-21T07:48:31.164ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f346b9ea-8b26-4ede-87d4-382bb71037da", "content-length": "682", "date": "Sat, 21 Dec 2024 07:48:31 GMT"} })
35512024-12-21T07:48:31.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35522024-12-21T07:48:31.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35532024-12-21T07:48:31.168ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35542024-12-21T07:48:31.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35552024-12-21T07:48:31.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35562024-12-21T07:48:31.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35572024-12-21T07:48:31.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35582024-12-21T07:48:31.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35592024-12-21T07:48:31.180ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 515.024859ms iteration = 12 status = {}
35602024-12-21T07:48:32.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 53e77847-b2d3-425c-9082-a1779d81c368 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35612024-12-21T07:48:32.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 53e77847-b2d3-425c-9082-a1779d81c368 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35622024-12-21T07:48:32.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1737 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 53e77847-b2d3-425c-9082-a1779d81c368 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35632024-12-21T07:48:33.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d4ed006a-a67f-49a5-9809-67e91fa659fe roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35642024-12-21T07:48:33.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d4ed006a-a67f-49a5-9809-67e91fa659fe resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35652024-12-21T07:48:33.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d4ed006a-a67f-49a5-9809-67e91fa659fe response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35662024-12-21T07:48:34.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d6d2eb9d-3294-41f5-92aa-6c2111a83075 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35672024-12-21T07:48:34.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d6d2eb9d-3294-41f5-92aa-6c2111a83075 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35682024-12-21T07:48:34.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d6d2eb9d-3294-41f5-92aa-6c2111a83075 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35692024-12-21T07:48:35.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5a4fce24-afa8-4ebf-a41f-d3a2169ffdd3 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35702024-12-21T07:48:35.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5a4fce24-afa8-4ebf-a41f-d3a2169ffdd3 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35712024-12-21T07:48:35.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5a4fce24-afa8-4ebf-a41f-d3a2169ffdd3 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35722024-12-21T07:48:36.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e553f668-8c8b-4470-81bf-7a72668757d3 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35732024-12-21T07:48:36.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e553f668-8c8b-4470-81bf-7a72668757d3 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35742024-12-21T07:48:36.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1757 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e553f668-8c8b-4470-81bf-7a72668757d3 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35752024-12-21T07:48:37.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 076a8b72-14e1-4190-b163-8efd6199a459 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35762024-12-21T07:48:37.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 076a8b72-14e1-4190-b163-8efd6199a459 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35772024-12-21T07:48:37.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 076a8b72-14e1-4190-b163-8efd6199a459 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35782024-12-21T07:48:38.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6f355df7-26e9-451f-b11c-4fc1e9a313e4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35792024-12-21T07:48:38.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6f355df7-26e9-451f-b11c-4fc1e9a313e4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35802024-12-21T07:48:38.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6f355df7-26e9-451f-b11c-4fc1e9a313e4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35812024-12-21T07:48:39.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 44b0ae72-52e9-4dfb-a0ed-21e645cae405 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35822024-12-21T07:48:39.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 44b0ae72-52e9-4dfb-a0ed-21e645cae405 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35832024-12-21T07:48:39.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 44b0ae72-52e9-4dfb-a0ed-21e645cae405 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35842024-12-21T07:48:39.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1321 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 2a9f5c36-e037-4797-a8a1-9c2f22de7049 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
35852024-12-21T07:48:40.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = aa27abcc-d2cb-4568-a0bb-660eb6021332 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35862024-12-21T07:48:40.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = aa27abcc-d2cb-4568-a0bb-660eb6021332 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35872024-12-21T07:48:40.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = aa27abcc-d2cb-4568-a0bb-660eb6021332 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
35882024-12-21T07:48:40.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
35892024-12-21T07:48:40.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
35902024-12-21T07:48:40.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35912024-12-21T07:48:40.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35922024-12-21T07:48:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35932024-12-21T07:48:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35942024-12-21T07:48:40.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35952024-12-21T07:48:40.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35962024-12-21T07:48:40.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35972024-12-21T07:48:40.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35982024-12-21T07:48:40.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35992024-12-21T07:48:40.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36002024-12-21T07:48:40.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36012024-12-21T07:48:40.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36022024-12-21T07:48:40.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36032024-12-21T07:48:40.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
36042024-12-21T07:48:40.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36052024-12-21T07:48:40.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36062024-12-21T07:48:40.687ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
36072024-12-21T07:48:40.687ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.403343ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
36082024-12-21T07:48:40.695ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.564189ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36092024-12-21T07:48:41.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 09e08f1f-ca69-4eb2-91bd-15431ba68ef1 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36102024-12-21T07:48:41.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 09e08f1f-ca69-4eb2-91bd-15431ba68ef1 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36112024-12-21T07:48:41.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1651 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 09e08f1f-ca69-4eb2-91bd-15431ba68ef1 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36122024-12-21T07:48:42.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 60414ea5-8544-41a6-b173-84221fffa381 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36132024-12-21T07:48:42.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 60414ea5-8544-41a6-b173-84221fffa381 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36142024-12-21T07:48:42.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 60414ea5-8544-41a6-b173-84221fffa381 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36152024-12-21T07:48:42.672ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
36162024-12-21T07:48:42.672ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
36172024-12-21T07:48:42.703ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
36182024-12-21T07:48:42.703ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:33479
36192024-12-21T07:48:42.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33479 req_id = 47419021-2b8d-4a27-902f-be678b4b2941 roles = RoleSet { roles: {} } uri = /metrics/producers
36202024-12-21T07:48:42.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33479 req_id = 47419021-2b8d-4a27-902f-be678b4b2941 resource = Database result = Ok(()) uri = /metrics/producers
36212024-12-21T07:48:42.740ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = a920b126-b55b-45c8-9984-5279bf662759
36222024-12-21T07:48:42.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37172 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33479 req_id = 47419021-2b8d-4a27-902f-be678b4b2941 response_code = 201 uri = /metrics/producers
36232024-12-21T07:48:42.740ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "47419021-2b8d-4a27-902f-be678b4b2941", "content-length": "41", "date": "Sat, 21 Dec 2024 07:48:42 GMT"} })
36242024-12-21T07:48:42.742ZDEBGnexus (producer-registration-task): registered with nexus successfully
36252024-12-21T07:48:42.742ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
36262024-12-21T07:48:43.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 88dc3712-e4ae-4f17-9a97-e5b2494ea392 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36272024-12-21T07:48:43.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 88dc3712-e4ae-4f17-9a97-e5b2494ea392 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36282024-12-21T07:48:43.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 88dc3712-e4ae-4f17-9a97-e5b2494ea392 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36292024-12-21T07:48:44.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c8959ab5-922b-452e-8822-90aa0178dab7 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36302024-12-21T07:48:44.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c8959ab5-922b-452e-8822-90aa0178dab7 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36312024-12-21T07:48:44.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c8959ab5-922b-452e-8822-90aa0178dab7 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36322024-12-21T07:48:45.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0f12734f-1c9c-4361-b2cb-1b07136aa33b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36332024-12-21T07:48:45.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0f12734f-1c9c-4361-b2cb-1b07136aa33b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36342024-12-21T07:48:45.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0f12734f-1c9c-4361-b2cb-1b07136aa33b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36352024-12-21T07:48:46.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fd2c598c-152b-4fa3-a0ff-1d637bd3664c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36362024-12-21T07:48:46.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fd2c598c-152b-4fa3-a0ff-1d637bd3664c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36372024-12-21T07:48:46.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fd2c598c-152b-4fa3-a0ff-1d637bd3664c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36382024-12-21T07:48:47.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 24d2bebb-db5e-4767-a85e-7a688fbe3f58 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36392024-12-21T07:48:47.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 24d2bebb-db5e-4767-a85e-7a688fbe3f58 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36402024-12-21T07:48:47.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 24d2bebb-db5e-4767-a85e-7a688fbe3f58 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36412024-12-21T07:48:48.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1be500dd-096d-451f-b891-c4612b95e2dc roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36422024-12-21T07:48:48.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1be500dd-096d-451f-b891-c4612b95e2dc resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36432024-12-21T07:48:48.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1be500dd-096d-451f-b891-c4612b95e2dc response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36442024-12-21T07:48:49.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c4ece730-03c9-4a38-a0ef-fde14056b3a8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36452024-12-21T07:48:49.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c4ece730-03c9-4a38-a0ef-fde14056b3a8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36462024-12-21T07:48:49.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c4ece730-03c9-4a38-a0ef-fde14056b3a8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36472024-12-21T07:48:49.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = c11ae28a-09b3-4dc4-a79d-6ee8fa536a92 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
36482024-12-21T07:48:49.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = c11ae28a-09b3-4dc4-a79d-6ee8fa536a92 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
36492024-12-21T07:48:49.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = c11ae28a-09b3-4dc4-a79d-6ee8fa536a92 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
36502024-12-21T07:48:49.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = e8d6b954-b4f0-4e19-8491-b81d813eef3e roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
36512024-12-21T07:48:49.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = e8d6b954-b4f0-4e19-8491-b81d813eef3e resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
36522024-12-21T07:48:49.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = e8d6b954-b4f0-4e19-8491-b81d813eef3e response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
36532024-12-21T07:48:49.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1274 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = d79c0891-1ecf-4801-b4da-2c406298d472 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
36542024-12-21T07:48:50.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 95499300-5af5-420e-91dc-e2b3e83cc20c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36552024-12-21T07:48:50.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 95499300-5af5-420e-91dc-e2b3e83cc20c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36562024-12-21T07:48:50.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 95499300-5af5-420e-91dc-e2b3e83cc20c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36572024-12-21T07:48:50.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
36582024-12-21T07:48:50.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36592024-12-21T07:48:50.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
36602024-12-21T07:48:50.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36612024-12-21T07:48:50.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36622024-12-21T07:48:50.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36632024-12-21T07:48:50.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36642024-12-21T07:48:50.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36652024-12-21T07:48:50.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36662024-12-21T07:48:50.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36672024-12-21T07:48:50.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36682024-12-21T07:48:50.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36692024-12-21T07:48:50.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36702024-12-21T07:48:50.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36712024-12-21T07:48:50.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36722024-12-21T07:48:50.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
36732024-12-21T07:48:50.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36742024-12-21T07:48:50.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36752024-12-21T07:48:50.686ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
36762024-12-21T07:48:50.686ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.353675ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
36772024-12-21T07:48:50.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.688784ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36782024-12-21T07:48:51.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 05b7e3a0-cf02-4750-aaae-afb7d4aa3d28 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36792024-12-21T07:48:51.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 05b7e3a0-cf02-4750-aaae-afb7d4aa3d28 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36802024-12-21T07:48:51.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2423 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 05b7e3a0-cf02-4750-aaae-afb7d4aa3d28 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36812024-12-21T07:48:52.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 68a7b141-bb8d-4ded-bbb6-07d4d5a11261 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36822024-12-21T07:48:52.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 68a7b141-bb8d-4ded-bbb6-07d4d5a11261 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36832024-12-21T07:48:52.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1724 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 68a7b141-bb8d-4ded-bbb6-07d4d5a11261 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36842024-12-21T07:48:53.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6b94724f-aeab-493b-a055-9eb338127720 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36852024-12-21T07:48:53.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6b94724f-aeab-493b-a055-9eb338127720 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36862024-12-21T07:48:53.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1897 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6b94724f-aeab-493b-a055-9eb338127720 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36872024-12-21T07:48:54.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f26a7011-83ff-4a0e-9e30-8cdb760aeea3 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36882024-12-21T07:48:54.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f26a7011-83ff-4a0e-9e30-8cdb760aeea3 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36892024-12-21T07:48:54.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f26a7011-83ff-4a0e-9e30-8cdb760aeea3 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36902024-12-21T07:48:55.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5d50a656-8b15-48c5-94b9-e42e4c0b489a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36912024-12-21T07:48:55.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5d50a656-8b15-48c5-94b9-e42e4c0b489a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36922024-12-21T07:48:55.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5d50a656-8b15-48c5-94b9-e42e4c0b489a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36932024-12-21T07:48:56.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a5fdfed6-8e89-479a-84da-aad688a5b7e9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36942024-12-21T07:48:56.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a5fdfed6-8e89-479a-84da-aad688a5b7e9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36952024-12-21T07:48:56.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a5fdfed6-8e89-479a-84da-aad688a5b7e9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36962024-12-21T07:48:57.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9b0672aa-29c3-411f-a05c-fd4f0110bfad roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36972024-12-21T07:48:57.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9b0672aa-29c3-411f-a05c-fd4f0110bfad resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36982024-12-21T07:48:57.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9b0672aa-29c3-411f-a05c-fd4f0110bfad response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
36992024-12-21T07:48:58.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cf5af9a6-3c84-4a42-a00f-52119a05b9ff roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
37002024-12-21T07:48:58.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cf5af9a6-3c84-4a42-a00f-52119a05b9ff resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
37012024-12-21T07:48:58.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cf5af9a6-3c84-4a42-a00f-52119a05b9ff response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
37022024-12-21T07:48:59.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5705b84b-f128-4029-ab7c-4e7cc304bc42 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
37032024-12-21T07:48:59.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5705b84b-f128-4029-ab7c-4e7cc304bc42 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
37042024-12-21T07:48:59.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5705b84b-f128-4029-ab7c-4e7cc304bc42 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
37052024-12-21T07:48:59.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = e24080d0-bb33-4514-bc49-2a989247c79d response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
37062024-12-21T07:49:00.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 66577754-a273-45e1-aacb-fbe6925a601f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
37072024-12-21T07:49:00.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 66577754-a273-45e1-aacb-fbe6925a601f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
37082024-12-21T07:49:00.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 66577754-a273-45e1-aacb-fbe6925a601f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
37092024-12-21T07:49:00.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d71816eb-cdfb-4485-ad0a-73c95d5c9bbe roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
37102024-12-21T07:49:00.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d71816eb-cdfb-4485-ad0a-73c95d5c9bbe resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
37112024-12-21T07:49:00.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d71816eb-cdfb-4485-ad0a-73c95d5c9bbe response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
37122024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
37132024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
37142024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
37152024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
37162024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
37172024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37182024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
37192024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37202024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
37212024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
37222024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37232024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
37242024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37252024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
37262024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37272024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
37282024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37292024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37302024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
37312024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
37322024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
37332024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37342024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
37352024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
37362024-12-21T07:49:00.665ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
37372024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
37382024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
37392024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37402024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
37412024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
37422024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37432024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
37442024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
37452024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
37462024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37472024-12-21T07:49:00.665ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
37482024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
37492024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37502024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
37512024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
37522024-12-21T07:49:00.665ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:39:00.665806718 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
37532024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
37542024-12-21T07:49:00.665ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
37552024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
37562024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
37572024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
37582024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37592024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
37602024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37612024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37622024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
37632024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
37642024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
37652024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
37662024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
37672024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
37682024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37692024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37702024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37712024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
37722024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
37732024-12-21T07:49:00.666ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b
37742024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37752024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.481\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b"}
37762024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
37772024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37782024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
37792024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37802024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37812024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
37822024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37832024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37842024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37852024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
37862024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37872024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37882024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37892024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37902024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
37912024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
37922024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
37932024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
37942024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37952024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37962024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37972024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37982024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37992024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38002024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38012024-12-21T07:49:00.666ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dd95bbd-e009-486c-8c96-451a6e195a49.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1274, tv_nsec: 366403075 } })
38022024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38032024-12-21T07:49:00.666ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bfae345-1659-4377-bca9-c55abec2aeb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7c426166-4f75-4a87-b9ac-c0d590aea49b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1274, tv_nsec: 366426695 } })
38042024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38052024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
38062024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38072024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38082024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38092024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38102024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38112024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
38122024-12-21T07:49:00.666ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.15841ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
38132024-12-21T07:49:00.667ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
38142024-12-21T07:49:00.667ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.356663ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
38152024-12-21T07:49:00.668ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38162024-12-21T07:49:00.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38172024-12-21T07:49:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38182024-12-21T07:49:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.174543ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
38192024-12-21T07:49:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.130422ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
38202024-12-21T07:49:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38212024-12-21T07:49:00.670ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38222024-12-21T07:49:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38232024-12-21T07:49:00.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38242024-12-21T07:49:00.673ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38252024-12-21T07:49:00.673ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38262024-12-21T07:49:00.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38272024-12-21T07:49:00.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38282024-12-21T07:49:00.676ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38292024-12-21T07:49:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38302024-12-21T07:49:00.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38312024-12-21T07:49:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38322024-12-21T07:49:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38332024-12-21T07:49:00.678ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38342024-12-21T07:49:00.679ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:39:00.665806718 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
38352024-12-21T07:49:00.679ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.627367ms iteration = 7 status = {"expiration":"2024-12-21T07:39:00.665806718Z","pruned":[]}
38362024-12-21T07:49:00.679ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38372024-12-21T07:49:00.680ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1274, tv_nsec: 380527730 } })
38382024-12-21T07:49:00.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
38392024-12-21T07:49:00.680ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38402024-12-21T07:49:00.680ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
38412024-12-21T07:49:00.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38422024-12-21T07:49:00.681ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38432024-12-21T07:49:00.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38442024-12-21T07:49:00.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
38452024-12-21T07:49:00.681ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38462024-12-21T07:49:00.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38472024-12-21T07:49:00.682ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38482024-12-21T07:49:00.683ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1274, tv_nsec: 383292906 } })
38492024-12-21T07:49:00.683ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
38502024-12-21T07:49:00.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38512024-12-21T07:49:00.684ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38522024-12-21T07:49:00.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38532024-12-21T07:49:00.686ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38542024-12-21T07:49:00.686ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38552024-12-21T07:49:00.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
38562024-12-21T07:49:00.689ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38572024-12-21T07:49:00.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38582024-12-21T07:49:00.689ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38592024-12-21T07:49:00.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
38602024-12-21T07:49:00.689ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38612024-12-21T07:49:00.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38622024-12-21T07:49:00.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38632024-12-21T07:49:00.694ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38642024-12-21T07:49:00.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38652024-12-21T07:49:00.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38662024-12-21T07:49:00.696ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38672024-12-21T07:49:00.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38682024-12-21T07:49:00.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38692024-12-21T07:49:00.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
38702024-12-21T07:49:00.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38712024-12-21T07:49:00.702ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38722024-12-21T07:49:00.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38732024-12-21T07:49:00.702ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38742024-12-21T07:49:00.702ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38752024-12-21T07:49:00.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38762024-12-21T07:49:00.704ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
38772024-12-21T07:49:00.704ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
38782024-12-21T07:49:00.704ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
38792024-12-21T07:49:00.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38802024-12-21T07:49:00.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38812024-12-21T07:49:00.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38822024-12-21T07:49:00.705ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38832024-12-21T07:49:00.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38842024-12-21T07:49:00.706ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38852024-12-21T07:49:00.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38862024-12-21T07:49:00.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38872024-12-21T07:49:00.710ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
38882024-12-21T07:49:00.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38892024-12-21T07:49:00.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38902024-12-21T07:49:00.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38912024-12-21T07:49:00.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
38922024-12-21T07:49:00.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38932024-12-21T07:49:00.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38942024-12-21T07:49:00.716ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
38952024-12-21T07:49:00.716ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 49.363341ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
38962024-12-21T07:49:00.717ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38972024-12-21T07:49:00.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38982024-12-21T07:49:00.718ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1274, tv_nsec: 417686579 } })
38992024-12-21T07:49:00.718ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
39002024-12-21T07:49:00.719ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.335547ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
39012024-12-21T07:49:00.719ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39022024-12-21T07:49:00.719ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 54.076999ms iteration = 4 status = {"nsuccess":5}
39032024-12-21T07:49:00.720ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39042024-12-21T07:49:00.720ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39052024-12-21T07:49:00.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39062024-12-21T07:49:00.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.643552ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39072024-12-21T07:49:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39082024-12-21T07:49:00.722ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39092024-12-21T07:49:00.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39102024-12-21T07:49:00.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39112024-12-21T07:49:00.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39122024-12-21T07:49:00.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39132024-12-21T07:49:00.724ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 59.287686ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
39142024-12-21T07:49:00.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39152024-12-21T07:49:00.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.47209ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
39162024-12-21T07:49:00.729ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39172024-12-21T07:49:00.729ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39182024-12-21T07:49:00.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39192024-12-21T07:49:00.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39202024-12-21T07:49:00.732ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39212024-12-21T07:49:00.732ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39222024-12-21T07:49:00.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39232024-12-21T07:49:00.733ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39242024-12-21T07:49:00.733ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39252024-12-21T07:49:00.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39262024-12-21T07:49:00.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39272024-12-21T07:49:00.733ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
39282024-12-21T07:49:00.733ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.233145ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
39292024-12-21T07:49:00.735ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
39302024-12-21T07:49:00.735ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
39312024-12-21T07:49:00.735ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.1261ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
39322024-12-21T07:49:00.739ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39332024-12-21T07:49:00.739ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39342024-12-21T07:49:00.739ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39352024-12-21T07:49:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39362024-12-21T07:49:00.740ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39372024-12-21T07:49:00.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39382024-12-21T07:49:00.742ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39392024-12-21T07:49:00.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39402024-12-21T07:49:00.744ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
39412024-12-21T07:49:00.744ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
39422024-12-21T07:49:00.744ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
39432024-12-21T07:49:00.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39442024-12-21T07:49:00.744ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39452024-12-21T07:49:00.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39462024-12-21T07:49:00.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39472024-12-21T07:49:00.744ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39482024-12-21T07:49:00.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39492024-12-21T07:49:00.746ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 80.239675ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39502024-12-21T07:49:00.746ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39512024-12-21T07:49:00.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
39522024-12-21T07:49:00.749ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39532024-12-21T07:49:00.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39542024-12-21T07:49:00.750ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 84.579157ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39552024-12-21T07:49:00.750ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39562024-12-21T07:49:00.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39572024-12-21T07:49:00.751ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39582024-12-21T07:49:00.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39592024-12-21T07:49:00.752ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
39602024-12-21T07:49:00.752ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39612024-12-21T07:49:00.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
39622024-12-21T07:49:00.753ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39632024-12-21T07:49:00.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39642024-12-21T07:49:00.754ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39652024-12-21T07:49:00.754ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39662024-12-21T07:49:00.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39672024-12-21T07:49:00.754ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
39682024-12-21T07:49:00.754ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
39692024-12-21T07:49:00.754ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 88.883649ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
39702024-12-21T07:49:00.762ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 97.098235ms iteration = 16 status = {"physical_disks_added":0}
39712024-12-21T07:49:00.763ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
39722024-12-21T07:49:00.763ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
39732024-12-21T07:49:00.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39742024-12-21T07:49:00.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39752024-12-21T07:49:00.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39762024-12-21T07:49:00.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39772024-12-21T07:49:00.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39782024-12-21T07:49:00.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39792024-12-21T07:49:00.770ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
39802024-12-21T07:49:00.770ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
39812024-12-21T07:49:00.770ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:43:39.444085 UTC dns_group = internal generation = 1
39822024-12-21T07:49:00.770ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 104.493168ms iteration = 8 status = {"generation":1}
39832024-12-21T07:49:00.772ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39842024-12-21T07:49:00.772ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
39852024-12-21T07:49:00.772ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 106.682235ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
39862024-12-21T07:49:00.775ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39872024-12-21T07:49:00.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39882024-12-21T07:49:00.778ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39892024-12-21T07:49:00.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39902024-12-21T07:49:00.784ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39912024-12-21T07:49:00.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
39922024-12-21T07:49:00.788ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39932024-12-21T07:49:00.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39942024-12-21T07:49:00.790ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 124.512961ms iteration = 13 status = 0
39952024-12-21T07:49:00.791ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:42:50.264108Z, time_modified: 2024-12-21T07:42:50.264108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }) }
39962024-12-21T07:49:00.791ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 125.02998ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]}},"default_endpoint":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
39972024-12-21T07:49:00.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39982024-12-21T07:49:00.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39992024-12-21T07:49:00.833ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
40002024-12-21T07:49:00.833ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 0 version = 2
40012024-12-21T07:49:00.833ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40022024-12-21T07:49:00.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40032024-12-21T07:49:00.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40042024-12-21T07:49:00.838ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40052024-12-21T07:49:00.838ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40062024-12-21T07:49:00.838ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecb6ca5a-6ca7-42f9-9853-4b4a00d8ff08", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:00 GMT"} })
40072024-12-21T07:49:00.838ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40082024-12-21T07:49:00.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40092024-12-21T07:49:00.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40102024-12-21T07:49:00.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40112024-12-21T07:49:00.839ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40122024-12-21T07:49:00.841ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 1 version = 2
40132024-12-21T07:49:00.841ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
40142024-12-21T07:49:00.841ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:43:41.075205 UTC dns_group = external generation = 2
40152024-12-21T07:49:00.841ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 176.050709ms iteration = 8 status = {"generation":2}
40162024-12-21T07:49:00.843ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40172024-12-21T07:49:00.843ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40182024-12-21T07:49:00.843ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a74046bc-f0bc-4d57-b092-e0a451cdb4ee", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:00 GMT"} })
40192024-12-21T07:49:00.843ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40202024-12-21T07:49:00.846ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40212024-12-21T07:49:00.877ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
40222024-12-21T07:49:00.877ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 211.696452ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
40232024-12-21T07:49:00.894ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
40242024-12-21T07:49:00.894ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40252024-12-21T07:49:00.894ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c34d70e-0523-4875-ae7b-025b99ab2feb", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:00 GMT"} })
40262024-12-21T07:49:00.894ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40272024-12-21T07:49:00.897ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
40282024-12-21T07:49:00.936ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40292024-12-21T07:49:00.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40302024-12-21T07:49:00.986ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
40312024-12-21T07:49:00.988ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40322024-12-21T07:49:00.988ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40332024-12-21T07:49:00.989ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b45400a-66ca-49b6-8134-d95d845dfae8", "content-length": "372", "date": "Sat, 21 Dec 2024 07:49:00 GMT"} })
40342024-12-21T07:49:00.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40352024-12-21T07:49:00.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40362024-12-21T07:49:01.003ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
40372024-12-21T07:49:01.003ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
40382024-12-21T07:49:01.004ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8400cb79-9e1a-487b-975c-8004a909a756", "date": "Sat, 21 Dec 2024 07:49:00 GMT"} })
40392024-12-21T07:49:01.004ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40402024-12-21T07:49:01.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40412024-12-21T07:49:01.005ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
40422024-12-21T07:49:01.005ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40432024-12-21T07:49:01.006ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "dffe6c0b-7a25-4c5e-b179-07d2bb8c4571", "content-length": "1", "date": "Sat, 21 Dec 2024 07:49:00 GMT"} })
40442024-12-21T07:49:01.006ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40452024-12-21T07:49:01.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40462024-12-21T07:49:01.007ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40472024-12-21T07:49:01.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40482024-12-21T07:49:01.010ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 344.40935ms iteration = 13 status = null
40492024-12-21T07:49:01.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40502024-12-21T07:49:01.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40512024-12-21T07:49:01.014ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40522024-12-21T07:49:01.014ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40532024-12-21T07:49:01.015ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ff0450ef-4869-42f7-9f9e-dbae5a802830", "date": "Sat, 21 Dec 2024 07:49:00 GMT"} })
40542024-12-21T07:49:01.016ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 350.808518ms iteration = 14 status = {}
40552024-12-21T07:49:01.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40562024-12-21T07:49:01.020ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40572024-12-21T07:49:01.020ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40582024-12-21T07:49:01.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40592024-12-21T07:49:01.021ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40602024-12-21T07:49:01.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40612024-12-21T07:49:01.023ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40622024-12-21T07:49:01.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40632024-12-21T07:49:01.240ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 574.588421ms iteration = 13 status = {}
40642024-12-21T07:49:01.261ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40652024-12-21T07:49:01.262ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "10b98120-c104-497c-822d-88f4f42adea9", "content-length": "691", "date": "Sat, 21 Dec 2024 07:49:01 GMT"} })
40662024-12-21T07:49:01.262ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
40672024-12-21T07:49:01.262ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
40682024-12-21T07:49:01.262ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
40692024-12-21T07:49:01.263ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 597.690835ms iteration = 13 status = {}
40702024-12-21T07:49:01.306ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
40712024-12-21T07:49:01.306ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a7f506c6-11b3-4c05-aff7-4cdc1fcdb16e", "date": "Sat, 21 Dec 2024 07:49:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
40722024-12-21T07:49:01.306ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
40732024-12-21T07:49:01.308ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2ed71d69-e347-461a-b9a6-4f385245f209", "date": "Sat, 21 Dec 2024 07:49:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
40742024-12-21T07:49:01.308ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
40752024-12-21T07:49:01.308ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
40762024-12-21T07:49:01.310ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
40772024-12-21T07:49:01.310ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 644.561045ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
40782024-12-21T07:49:01.316ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40792024-12-21T07:49:01.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40802024-12-21T07:49:01.318ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
40812024-12-21T07:49:01.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40822024-12-21T07:49:01.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40832024-12-21T07:49:01.328ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
40842024-12-21T07:49:01.328ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8296f7a2-70bb-4a61-840a-5d1d2577d635", "content-length": "134", "date": "Sat, 21 Dec 2024 07:49:00 GMT"} })
40852024-12-21T07:49:01.328ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
40862024-12-21T07:49:01.328ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
40872024-12-21T07:49:01.328ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
40882024-12-21T07:49:01.328ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40892024-12-21T07:49:01.328ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40902024-12-21T07:49:01.328ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40912024-12-21T07:49:01.328ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40922024-12-21T07:49:01.328ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40932024-12-21T07:49:01.329ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40942024-12-21T07:49:01.329ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40952024-12-21T07:49:01.329ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
40962024-12-21T07:49:01.329ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40972024-12-21T07:49:01.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40982024-12-21T07:49:01.340ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
40992024-12-21T07:49:01.340ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3f66e2f-f320-47da-9b6f-a89447af2198", "content-length": "2", "date": "Sat, 21 Dec 2024 07:49:00 GMT"} })
41002024-12-21T07:49:01.340ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41012024-12-21T07:49:01.340ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "519a4995-c6f8-46c3-8470-81badc77b2a3", "content-length": "52", "date": "Sat, 21 Dec 2024 07:49:00 GMT"} })
41022024-12-21T07:49:01.340ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
41032024-12-21T07:49:01.340ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41042024-12-21T07:49:01.341ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
41052024-12-21T07:49:01.342ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5a3538d9-69a2-4211-9220-88f4a69a2a6f", "date": "Sat, 21 Dec 2024 07:49:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41062024-12-21T07:49:01.342ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41072024-12-21T07:49:01.344ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "823a626f-cdea-4f92-9714-dc1784bc4a2f", "date": "Sat, 21 Dec 2024 07:49:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41082024-12-21T07:49:01.344ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41092024-12-21T07:49:01.345ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5a5a4f8e-6bb6-4220-adf4-43b8c3c96c3a", "date": "Sat, 21 Dec 2024 07:49:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41102024-12-21T07:49:01.345ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41112024-12-21T07:49:01.347ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
41122024-12-21T07:49:01.347ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 681.361468ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
41132024-12-21T07:49:01.480ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bb12715a-2ad1-41a0-b4ac-9c98432c6b73", "date": "Sat, 21 Dec 2024 07:49:01 GMT"} })
41142024-12-21T07:49:01.480ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
41152024-12-21T07:49:01.480ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41162024-12-21T07:49:01.480ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a6af4d9-0eb0-4e2c-a430-32d52c5fac64", "content-length": "682", "date": "Sat, 21 Dec 2024 07:49:01 GMT"} })
41172024-12-21T07:49:01.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41182024-12-21T07:49:01.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41192024-12-21T07:49:01.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41202024-12-21T07:49:01.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41212024-12-21T07:49:01.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41222024-12-21T07:49:01.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41232024-12-21T07:49:01.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41242024-12-21T07:49:01.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41252024-12-21T07:49:01.497ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 831.880152ms iteration = 13 status = {}
41262024-12-21T07:49:01.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 56bb5a56-524d-45f8-b6b1-90933202664c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41272024-12-21T07:49:01.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 56bb5a56-524d-45f8-b6b1-90933202664c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41282024-12-21T07:49:01.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 56bb5a56-524d-45f8-b6b1-90933202664c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41292024-12-21T07:49:02.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a40b6574-b017-4ed7-b8fb-0a1c1546b6c1 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41302024-12-21T07:49:02.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a40b6574-b017-4ed7-b8fb-0a1c1546b6c1 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41312024-12-21T07:49:02.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a40b6574-b017-4ed7-b8fb-0a1c1546b6c1 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41322024-12-21T07:49:03.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7b632eaf-5bec-4ebb-91e4-a42609be37e2 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41332024-12-21T07:49:03.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7b632eaf-5bec-4ebb-91e4-a42609be37e2 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41342024-12-21T07:49:03.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7b632eaf-5bec-4ebb-91e4-a42609be37e2 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41352024-12-21T07:49:04.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5408c0cb-cb70-4415-b2ea-cb370d74ce85 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41362024-12-21T07:49:04.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5408c0cb-cb70-4415-b2ea-cb370d74ce85 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41372024-12-21T07:49:04.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5408c0cb-cb70-4415-b2ea-cb370d74ce85 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41382024-12-21T07:49:05.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cb2b721e-b9e1-4583-8a6c-f4f322553bd9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41392024-12-21T07:49:05.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cb2b721e-b9e1-4583-8a6c-f4f322553bd9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41402024-12-21T07:49:05.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cb2b721e-b9e1-4583-8a6c-f4f322553bd9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41412024-12-21T07:49:06.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ac060ac8-a9ad-4676-9c50-2480af74aaa7 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41422024-12-21T07:49:06.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ac060ac8-a9ad-4676-9c50-2480af74aaa7 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41432024-12-21T07:49:06.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ac060ac8-a9ad-4676-9c50-2480af74aaa7 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41442024-12-21T07:49:07.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8a609510-2a9e-4c0e-8a38-4126a37fff42 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41452024-12-21T07:49:07.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8a609510-2a9e-4c0e-8a38-4126a37fff42 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41462024-12-21T07:49:07.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8a609510-2a9e-4c0e-8a38-4126a37fff42 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41472024-12-21T07:49:08.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 87fb511b-0b2b-4771-9a1c-872f9a796d6a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41482024-12-21T07:49:08.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 87fb511b-0b2b-4771-9a1c-872f9a796d6a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41492024-12-21T07:49:08.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2471 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 87fb511b-0b2b-4771-9a1c-872f9a796d6a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41502024-12-21T07:49:09.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1422 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 343cd45c-1d3c-402f-b6e6-362d970087b6 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
41512024-12-21T07:49:09.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7bf0e2d5-e9ae-468f-9d43-c69925d2073d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41522024-12-21T07:49:09.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7bf0e2d5-e9ae-468f-9d43-c69925d2073d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41532024-12-21T07:49:09.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7bf0e2d5-e9ae-468f-9d43-c69925d2073d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41542024-12-21T07:49:10.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
41552024-12-21T07:49:10.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
41562024-12-21T07:49:10.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41572024-12-21T07:49:10.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41582024-12-21T07:49:10.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41592024-12-21T07:49:10.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41602024-12-21T07:49:10.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41612024-12-21T07:49:10.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41622024-12-21T07:49:10.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41632024-12-21T07:49:10.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41642024-12-21T07:49:10.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41652024-12-21T07:49:10.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41662024-12-21T07:49:10.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41672024-12-21T07:49:10.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
41682024-12-21T07:49:10.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41692024-12-21T07:49:10.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41702024-12-21T07:49:10.688ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
41712024-12-21T07:49:10.688ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.015783ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
41722024-12-21T07:49:10.695ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41732024-12-21T07:49:10.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41742024-12-21T07:49:10.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.548944ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41752024-12-21T07:49:10.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d62ed31d-9192-4923-b20e-5e631c0a7762 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41762024-12-21T07:49:10.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d62ed31d-9192-4923-b20e-5e631c0a7762 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41772024-12-21T07:49:10.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d62ed31d-9192-4923-b20e-5e631c0a7762 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41782024-12-21T07:49:11.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ae32d0af-9b4a-4426-b9cd-802ccf1fa719 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41792024-12-21T07:49:11.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ae32d0af-9b4a-4426-b9cd-802ccf1fa719 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41802024-12-21T07:49:11.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ae32d0af-9b4a-4426-b9cd-802ccf1fa719 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41812024-12-21T07:49:12.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b102d1cf-3e9f-4d33-be3d-57bfe1bc1216 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41822024-12-21T07:49:12.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b102d1cf-3e9f-4d33-be3d-57bfe1bc1216 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41832024-12-21T07:49:12.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b102d1cf-3e9f-4d33-be3d-57bfe1bc1216 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41842024-12-21T07:49:13.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2ae18ad1-0578-4f58-9b4b-1c3a93b33826 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41852024-12-21T07:49:13.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2ae18ad1-0578-4f58-9b4b-1c3a93b33826 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41862024-12-21T07:49:13.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2ae18ad1-0578-4f58-9b4b-1c3a93b33826 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41872024-12-21T07:49:14.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = be9dc7b6-6b01-4923-84e2-7bb1dae3b967 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41882024-12-21T07:49:14.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = be9dc7b6-6b01-4923-84e2-7bb1dae3b967 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41892024-12-21T07:49:14.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = be9dc7b6-6b01-4923-84e2-7bb1dae3b967 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41902024-12-21T07:49:15.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2d69d5e-8a28-4f31-8b5b-9f11973c127b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41912024-12-21T07:49:15.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2d69d5e-8a28-4f31-8b5b-9f11973c127b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41922024-12-21T07:49:15.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2d69d5e-8a28-4f31-8b5b-9f11973c127b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41932024-12-21T07:49:16.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a661ee28-13dc-4a50-8d3b-bf1e71b1f157 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41942024-12-21T07:49:16.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a661ee28-13dc-4a50-8d3b-bf1e71b1f157 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41952024-12-21T07:49:16.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a661ee28-13dc-4a50-8d3b-bf1e71b1f157 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41962024-12-21T07:49:17.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7bdb8c90-4c42-423c-8ddc-83699770b0d8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41972024-12-21T07:49:18.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7bdb8c90-4c42-423c-8ddc-83699770b0d8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41982024-12-21T07:49:18.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7bdb8c90-4c42-423c-8ddc-83699770b0d8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
41992024-12-21T07:49:19.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6ccf02f1-b887-4ff6-97a1-23fe5344b932 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42002024-12-21T07:49:19.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6ccf02f1-b887-4ff6-97a1-23fe5344b932 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42012024-12-21T07:49:19.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6ccf02f1-b887-4ff6-97a1-23fe5344b932 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42022024-12-21T07:49:19.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1337 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 11db135d-beb7-4790-afbb-5c719897c1e9 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
42032024-12-21T07:49:20.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 07aa4e00-4f6b-4fbd-8276-7b6c7d6bfcc9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42042024-12-21T07:49:20.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 07aa4e00-4f6b-4fbd-8276-7b6c7d6bfcc9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42052024-12-21T07:49:20.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 07aa4e00-4f6b-4fbd-8276-7b6c7d6bfcc9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42062024-12-21T07:49:20.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
42072024-12-21T07:49:20.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
42082024-12-21T07:49:20.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42092024-12-21T07:49:20.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42102024-12-21T07:49:20.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42112024-12-21T07:49:20.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42122024-12-21T07:49:20.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42132024-12-21T07:49:20.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42142024-12-21T07:49:20.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42152024-12-21T07:49:20.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42162024-12-21T07:49:20.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42172024-12-21T07:49:20.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42182024-12-21T07:49:20.692ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42192024-12-21T07:49:20.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42202024-12-21T07:49:20.694ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.184389ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42212024-12-21T07:49:20.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42222024-12-21T07:49:20.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
42232024-12-21T07:49:20.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42242024-12-21T07:49:20.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42252024-12-21T07:49:20.716ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
42262024-12-21T07:49:20.716ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.035293ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
42272024-12-21T07:49:21.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 931c0cc1-4890-45b7-bf45-3d14fbd318fd roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42282024-12-21T07:49:21.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 931c0cc1-4890-45b7-bf45-3d14fbd318fd resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42292024-12-21T07:49:21.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 931c0cc1-4890-45b7-bf45-3d14fbd318fd response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42302024-12-21T07:49:22.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cf37d377-6ce4-4d1d-8568-8605ddfbeac7 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42312024-12-21T07:49:22.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cf37d377-6ce4-4d1d-8568-8605ddfbeac7 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42322024-12-21T07:49:22.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cf37d377-6ce4-4d1d-8568-8605ddfbeac7 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42332024-12-21T07:49:23.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 68cf6a07-83e3-406e-87c7-64ed2b871d1f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42342024-12-21T07:49:23.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 68cf6a07-83e3-406e-87c7-64ed2b871d1f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42352024-12-21T07:49:23.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 68cf6a07-83e3-406e-87c7-64ed2b871d1f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42362024-12-21T07:49:24.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 89d4ef98-abe8-40b8-9352-7a95a0d4a5ee roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42372024-12-21T07:49:24.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 89d4ef98-abe8-40b8-9352-7a95a0d4a5ee resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42382024-12-21T07:49:24.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 89d4ef98-abe8-40b8-9352-7a95a0d4a5ee response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42392024-12-21T07:49:25.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 97ae85aa-7e45-4d4f-9734-6d4757624541 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42402024-12-21T07:49:25.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 97ae85aa-7e45-4d4f-9734-6d4757624541 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42412024-12-21T07:49:25.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 97ae85aa-7e45-4d4f-9734-6d4757624541 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42422024-12-21T07:49:26.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8f64a81-4182-424e-af3d-88915ab5de0d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42432024-12-21T07:49:26.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8f64a81-4182-424e-af3d-88915ab5de0d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42442024-12-21T07:49:26.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8f64a81-4182-424e-af3d-88915ab5de0d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42452024-12-21T07:49:27.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bda52b60-86a2-4151-85ec-db3db1a9c881 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42462024-12-21T07:49:27.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bda52b60-86a2-4151-85ec-db3db1a9c881 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42472024-12-21T07:49:27.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bda52b60-86a2-4151-85ec-db3db1a9c881 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42482024-12-21T07:49:28.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e7a6c054-ff37-48c6-bc29-400f2f3405d3 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42492024-12-21T07:49:28.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e7a6c054-ff37-48c6-bc29-400f2f3405d3 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42502024-12-21T07:49:28.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e7a6c054-ff37-48c6-bc29-400f2f3405d3 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42512024-12-21T07:49:29.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fe606514-2212-4a8e-b4bc-1e1e279261c5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42522024-12-21T07:49:29.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fe606514-2212-4a8e-b4bc-1e1e279261c5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42532024-12-21T07:49:29.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fe606514-2212-4a8e-b4bc-1e1e279261c5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42542024-12-21T07:49:29.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1406 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 56c09560-0540-409b-ad33-d1b0c7ff3ec5 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
42552024-12-21T07:49:30.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d8ae8b64-6fa5-4225-a759-00e6bad063eb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42562024-12-21T07:49:30.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d8ae8b64-6fa5-4225-a759-00e6bad063eb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42572024-12-21T07:49:30.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d8ae8b64-6fa5-4225-a759-00e6bad063eb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
42582024-12-21T07:49:30.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 1c74460d-6d08-4d98-a367-59075b8d7734 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
42592024-12-21T07:49:30.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 1c74460d-6d08-4d98-a367-59075b8d7734 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
42602024-12-21T07:49:30.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3616 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 1c74460d-6d08-4d98-a367-59075b8d7734 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
42612024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
42622024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
42632024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
42642024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42652024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42662024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42672024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
42682024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
42692024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42702024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42712024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
42722024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
42732024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42742024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42752024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42762024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
42772024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42782024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
42792024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42802024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
42812024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42822024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
42832024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
42842024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
42852024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42862024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
42872024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
42882024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42892024-12-21T07:49:30.665ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42902024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42912024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
42922024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
42932024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
42942024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
42952024-12-21T07:49:30.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42962024-12-21T07:49:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42972024-12-21T07:49:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42982024-12-21T07:49:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42992024-12-21T07:49:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43002024-12-21T07:49:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43012024-12-21T07:49:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43022024-12-21T07:49:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43032024-12-21T07:49:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43042024-12-21T07:49:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43052024-12-21T07:49:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43062024-12-21T07:49:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43072024-12-21T07:49:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43082024-12-21T07:49:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43092024-12-21T07:49:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43102024-12-21T07:49:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
43112024-12-21T07:49:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43122024-12-21T07:49:30.668ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43132024-12-21T07:49:30.668ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43142024-12-21T07:49:30.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43152024-12-21T07:49:30.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43162024-12-21T07:49:30.669ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.384626ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43172024-12-21T07:49:30.670ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43182024-12-21T07:49:30.670ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43192024-12-21T07:49:30.670ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43202024-12-21T07:49:30.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43212024-12-21T07:49:30.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43222024-12-21T07:49:30.670ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43232024-12-21T07:49:30.670ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 370285623 } })
43242024-12-21T07:49:30.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43252024-12-21T07:49:30.670ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
43262024-12-21T07:49:30.672ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 372450069 } })
43272024-12-21T07:49:30.672ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
43282024-12-21T07:49:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43292024-12-21T07:49:30.673ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43302024-12-21T07:49:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43312024-12-21T07:49:30.675ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43322024-12-21T07:49:30.675ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43332024-12-21T07:49:30.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43342024-12-21T07:49:30.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43352024-12-21T07:49:30.678ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43362024-12-21T07:49:30.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43372024-12-21T07:49:30.678ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43382024-12-21T07:49:30.678ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43392024-12-21T07:49:30.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43402024-12-21T07:49:30.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43412024-12-21T07:49:30.679ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43422024-12-21T07:49:30.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43432024-12-21T07:49:30.683ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43442024-12-21T07:49:30.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43452024-12-21T07:49:30.683ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43462024-12-21T07:49:30.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43472024-12-21T07:49:30.684ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43482024-12-21T07:49:30.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43492024-12-21T07:49:30.685ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43502024-12-21T07:49:30.690ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
43512024-12-21T07:49:30.690ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43522024-12-21T07:49:30.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43532024-12-21T07:49:30.705ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43542024-12-21T07:49:30.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43552024-12-21T07:49:30.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43562024-12-21T07:49:30.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43572024-12-21T07:49:30.712ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43582024-12-21T07:49:30.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43592024-12-21T07:49:30.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 47.094954ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
43602024-12-21T07:49:30.715ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
43612024-12-21T07:49:30.715ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.826499ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
43622024-12-21T07:49:30.716ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1304, tv_nsec: 415991343 } })
43632024-12-21T07:49:30.716ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43642024-12-21T07:49:30.716ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
43652024-12-21T07:49:30.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43662024-12-21T07:49:30.718ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 53.052623ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43672024-12-21T07:49:30.719ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43682024-12-21T07:49:30.719ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43692024-12-21T07:49:30.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43702024-12-21T07:49:30.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43712024-12-21T07:49:30.721ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.528164ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
43722024-12-21T07:49:30.721ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43732024-12-21T07:49:30.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43742024-12-21T07:49:30.722ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43752024-12-21T07:49:30.722ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43762024-12-21T07:49:30.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43772024-12-21T07:49:30.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43782024-12-21T07:49:30.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.375754ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43792024-12-21T07:49:30.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43802024-12-21T07:49:30.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43812024-12-21T07:49:30.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
43822024-12-21T07:49:30.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43832024-12-21T07:49:30.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43842024-12-21T07:49:30.727ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43852024-12-21T07:49:30.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43862024-12-21T07:49:30.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43872024-12-21T07:49:30.728ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43882024-12-21T07:49:30.728ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 63.406085ms iteration = 14 status = 0
43892024-12-21T07:49:30.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43902024-12-21T07:49:30.729ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43912024-12-21T07:49:30.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43922024-12-21T07:49:30.733ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
43932024-12-21T07:49:30.733ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.285026ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
43942024-12-21T07:49:30.750ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43952024-12-21T07:49:30.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43962024-12-21T07:49:30.753ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
43972024-12-21T07:49:30.753ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43982024-12-21T07:49:30.753ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5587659d-7243-4f44-943d-8b6d2494e808", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:30 GMT"} })
43992024-12-21T07:49:30.753ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44002024-12-21T07:49:30.755ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44012024-12-21T07:49:30.757ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.756467ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44022024-12-21T07:49:30.763ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44032024-12-21T07:49:30.763ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44042024-12-21T07:49:30.763ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 97.36159ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44052024-12-21T07:49:30.779ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 113.491998ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
44062024-12-21T07:49:30.781ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
44072024-12-21T07:49:30.781ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44082024-12-21T07:49:30.781ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5d1df36-3ebb-4d0f-835e-e979d690e2e6", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:30 GMT"} })
44092024-12-21T07:49:30.781ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44102024-12-21T07:49:30.783ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44112024-12-21T07:49:30.789ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44122024-12-21T07:49:30.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44132024-12-21T07:49:30.852ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 187.024682ms iteration = 14 status = {}
44142024-12-21T07:49:30.856ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 191.12083ms iteration = 17 status = {"physical_disks_added":0}
44152024-12-21T07:49:30.891ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
44162024-12-21T07:49:30.891ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "aaaeb0ea-710b-4564-8ce0-1a38aab0255a", "content-length": "1", "date": "Sat, 21 Dec 2024 07:49:30 GMT"} })
44172024-12-21T07:49:30.894ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44182024-12-21T07:49:30.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44192024-12-21T07:49:30.906ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
44202024-12-21T07:49:30.906ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44212024-12-21T07:49:30.906ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbbaebe6-a3e7-4ac4-a36e-cf3d49fa22e1", "content-length": "26", "date": "Sat, 21 Dec 2024 07:49:30 GMT"} })
44222024-12-21T07:49:30.906ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44232024-12-21T07:49:30.908ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
44242024-12-21T07:49:30.926ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
44252024-12-21T07:49:30.926ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44262024-12-21T07:49:30.926ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d3ba719-a1c6-4b40-9d04-f7d0fdbf4cb7", "content-length": "372", "date": "Sat, 21 Dec 2024 07:49:30 GMT"} })
44272024-12-21T07:49:30.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44282024-12-21T07:49:30.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44292024-12-21T07:49:30.928ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 262.857673ms iteration = 14 status = null
44302024-12-21T07:49:30.971ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
44312024-12-21T07:49:30.971ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
44322024-12-21T07:49:30.971ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "665c6d7b-e819-452a-81c0-9865e738611e", "date": "Sat, 21 Dec 2024 07:49:30 GMT"} })
44332024-12-21T07:49:30.971ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44342024-12-21T07:49:30.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44352024-12-21T07:49:30.974ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44362024-12-21T07:49:30.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44372024-12-21T07:49:30.977ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44382024-12-21T07:49:30.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44392024-12-21T07:49:30.981ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
44402024-12-21T07:49:30.981ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44412024-12-21T07:49:30.982ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ae670836-5dba-4a2e-a694-ed819b0b5017", "date": "Sat, 21 Dec 2024 07:49:30 GMT"} })
44422024-12-21T07:49:30.984ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 318.590811ms iteration = 15 status = {}
44432024-12-21T07:49:31.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44442024-12-21T07:49:31.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44452024-12-21T07:49:31.022ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
44462024-12-21T07:49:31.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44472024-12-21T07:49:31.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44482024-12-21T07:49:31.033ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44492024-12-21T07:49:31.033ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4808bfe0-02d6-47bc-9b32-d815a493e60c", "content-length": "134", "date": "Sat, 21 Dec 2024 07:49:30 GMT"} })
44502024-12-21T07:49:31.033ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
44512024-12-21T07:49:31.033ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
44522024-12-21T07:49:31.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44532024-12-21T07:49:31.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44542024-12-21T07:49:31.033ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
44552024-12-21T07:49:31.034ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44562024-12-21T07:49:31.034ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44572024-12-21T07:49:31.034ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44582024-12-21T07:49:31.034ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44592024-12-21T07:49:31.034ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44602024-12-21T07:49:31.034ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44612024-12-21T07:49:31.034ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44622024-12-21T07:49:31.034ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
44632024-12-21T07:49:31.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44642024-12-21T07:49:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44652024-12-21T07:49:31.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44662024-12-21T07:49:31.036ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44672024-12-21T07:49:31.036ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e56c9b02-b974-4f3d-8860-142a7e5f4ec2", "content-length": "2", "date": "Sat, 21 Dec 2024 07:49:30 GMT"} })
44682024-12-21T07:49:31.036ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44692024-12-21T07:49:31.037ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8850580f-ef13-4cd1-9e7d-7ef1cb83720b", "content-length": "52", "date": "Sat, 21 Dec 2024 07:49:30 GMT"} })
44702024-12-21T07:49:31.037ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
44712024-12-21T07:49:31.037ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44722024-12-21T07:49:31.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44732024-12-21T07:49:31.037ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44742024-12-21T07:49:31.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44752024-12-21T07:49:31.038ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44762024-12-21T07:49:31.040ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44772024-12-21T07:49:31.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44782024-12-21T07:49:31.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44792024-12-21T07:49:31.078ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44802024-12-21T07:49:31.132ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1be2d6db-6d57-4311-b3e2-a135a519b863", "date": "Sat, 21 Dec 2024 07:49:30 GMT"} })
44812024-12-21T07:49:31.132ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
44822024-12-21T07:49:31.132ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44832024-12-21T07:49:31.133ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9efb8bdf-7c86-4e30-8edb-3c0cedaed8c9", "content-length": "682", "date": "Sat, 21 Dec 2024 07:49:31 GMT"} })
44842024-12-21T07:49:31.133ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44852024-12-21T07:49:31.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44862024-12-21T07:49:31.136ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "64e1b794-4828-46f8-aeba-7db30d60dea5", "content-length": "691", "date": "Sat, 21 Dec 2024 07:49:31 GMT"} })
44872024-12-21T07:49:31.136ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
44882024-12-21T07:49:31.136ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
44892024-12-21T07:49:31.137ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
44902024-12-21T07:49:31.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44912024-12-21T07:49:31.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44922024-12-21T07:49:31.138ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 472.471561ms iteration = 14 status = {}
44932024-12-21T07:49:31.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44942024-12-21T07:49:31.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44952024-12-21T07:49:31.142ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44962024-12-21T07:49:31.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44972024-12-21T07:49:31.150ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 485.0324ms iteration = 14 status = {}
44982024-12-21T07:49:31.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 293c784f-87a2-41bf-bfd8-2c9f2ab57e1d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
44992024-12-21T07:49:31.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 293c784f-87a2-41bf-bfd8-2c9f2ab57e1d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45002024-12-21T07:49:31.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 293c784f-87a2-41bf-bfd8-2c9f2ab57e1d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45012024-12-21T07:49:32.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f215750d-2294-47c9-bd4e-b02d98a206f6 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45022024-12-21T07:49:32.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f215750d-2294-47c9-bd4e-b02d98a206f6 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45032024-12-21T07:49:32.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f215750d-2294-47c9-bd4e-b02d98a206f6 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45042024-12-21T07:49:33.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a4fc1b13-94a5-47de-9c20-8ac714895062 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45052024-12-21T07:49:33.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a4fc1b13-94a5-47de-9c20-8ac714895062 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45062024-12-21T07:49:33.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a4fc1b13-94a5-47de-9c20-8ac714895062 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45072024-12-21T07:49:34.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 00654a59-404d-40b7-baee-4e07ba4fbe4f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45082024-12-21T07:49:34.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 00654a59-404d-40b7-baee-4e07ba4fbe4f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45092024-12-21T07:49:34.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 00654a59-404d-40b7-baee-4e07ba4fbe4f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45102024-12-21T07:49:34.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = faadbc49-e61e-4ae4-b752-f112fd428ddf roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
45112024-12-21T07:49:34.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = faadbc49-e61e-4ae4-b752-f112fd428ddf resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
45122024-12-21T07:49:34.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = faadbc49-e61e-4ae4-b752-f112fd428ddf response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
45132024-12-21T07:49:34.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 87873e63-3ab3-4ed4-84bd-f81a1c7dcd28 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
45142024-12-21T07:49:34.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 87873e63-3ab3-4ed4-84bd-f81a1c7dcd28 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
45152024-12-21T07:49:34.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 87873e63-3ab3-4ed4-84bd-f81a1c7dcd28 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
45162024-12-21T07:49:35.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5751688b-1c9f-4c10-aa41-93b97b9cfa8a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45172024-12-21T07:49:35.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5751688b-1c9f-4c10-aa41-93b97b9cfa8a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45182024-12-21T07:49:35.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5751688b-1c9f-4c10-aa41-93b97b9cfa8a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45192024-12-21T07:49:36.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4f971ebb-7e20-4b6f-91fd-b8377aeca253 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45202024-12-21T07:49:36.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4f971ebb-7e20-4b6f-91fd-b8377aeca253 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45212024-12-21T07:49:36.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1662 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4f971ebb-7e20-4b6f-91fd-b8377aeca253 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45222024-12-21T07:49:37.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b363862e-48db-4bc0-a014-dd6d97bc295e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45232024-12-21T07:49:37.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b363862e-48db-4bc0-a014-dd6d97bc295e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45242024-12-21T07:49:37.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b363862e-48db-4bc0-a014-dd6d97bc295e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45252024-12-21T07:49:38.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f9887502-9757-4fa6-a1db-525129767f81 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45262024-12-21T07:49:38.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f9887502-9757-4fa6-a1db-525129767f81 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45272024-12-21T07:49:38.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f9887502-9757-4fa6-a1db-525129767f81 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45282024-12-21T07:49:39.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 98901cdc-952b-4fec-896e-430ed17265a1 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45292024-12-21T07:49:39.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 98901cdc-952b-4fec-896e-430ed17265a1 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45302024-12-21T07:49:39.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 98901cdc-952b-4fec-896e-430ed17265a1 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45312024-12-21T07:49:39.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1314 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 409fc626-818a-45d4-a8d1-144193205249 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
45322024-12-21T07:49:40.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 77683606-0c59-4a23-bae8-0230014ecdb1 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45332024-12-21T07:49:40.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 77683606-0c59-4a23-bae8-0230014ecdb1 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45342024-12-21T07:49:40.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 77683606-0c59-4a23-bae8-0230014ecdb1 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45352024-12-21T07:49:40.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
45362024-12-21T07:49:40.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
45372024-12-21T07:49:40.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45382024-12-21T07:49:40.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45392024-12-21T07:49:40.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45402024-12-21T07:49:40.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45412024-12-21T07:49:40.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45422024-12-21T07:49:40.668ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45432024-12-21T07:49:40.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45442024-12-21T07:49:40.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45452024-12-21T07:49:40.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45462024-12-21T07:49:40.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45472024-12-21T07:49:40.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45482024-12-21T07:49:40.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45492024-12-21T07:49:40.675ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 8.852288ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45502024-12-21T07:49:40.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45512024-12-21T07:49:40.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
45522024-12-21T07:49:40.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45532024-12-21T07:49:40.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45542024-12-21T07:49:40.688ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
45552024-12-21T07:49:40.688ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.060797ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
45562024-12-21T07:49:41.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cf4093b6-40a8-43f0-97b8-e6c93f03f1e3 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45572024-12-21T07:49:41.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cf4093b6-40a8-43f0-97b8-e6c93f03f1e3 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45582024-12-21T07:49:41.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cf4093b6-40a8-43f0-97b8-e6c93f03f1e3 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45592024-12-21T07:49:42.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bcad53f6-c608-4bee-b577-b35c1e945d6e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45602024-12-21T07:49:42.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bcad53f6-c608-4bee-b577-b35c1e945d6e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45612024-12-21T07:49:42.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bcad53f6-c608-4bee-b577-b35c1e945d6e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45622024-12-21T07:49:43.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 914f310e-b1fb-4052-8925-bb915218ad01 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45632024-12-21T07:49:43.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 914f310e-b1fb-4052-8925-bb915218ad01 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45642024-12-21T07:49:43.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 914f310e-b1fb-4052-8925-bb915218ad01 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45652024-12-21T07:49:44.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 64332e2d-47dd-4305-a91e-8a12860dc2d0 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45662024-12-21T07:49:44.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 64332e2d-47dd-4305-a91e-8a12860dc2d0 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45672024-12-21T07:49:44.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 64332e2d-47dd-4305-a91e-8a12860dc2d0 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45682024-12-21T07:49:45.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = adee8f9c-f8b5-4b1f-bec1-eb6ab65f533a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45692024-12-21T07:49:45.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = adee8f9c-f8b5-4b1f-bec1-eb6ab65f533a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45702024-12-21T07:49:45.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = adee8f9c-f8b5-4b1f-bec1-eb6ab65f533a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45712024-12-21T07:49:46.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9f7d6615-9b0d-48a2-a63b-b7fbe9f99c7c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45722024-12-21T07:49:46.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9f7d6615-9b0d-48a2-a63b-b7fbe9f99c7c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45732024-12-21T07:49:46.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9f7d6615-9b0d-48a2-a63b-b7fbe9f99c7c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45742024-12-21T07:49:47.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 557b1d2b-48f2-4746-9e0b-b4723bd5315e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45752024-12-21T07:49:47.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 557b1d2b-48f2-4746-9e0b-b4723bd5315e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45762024-12-21T07:49:47.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 557b1d2b-48f2-4746-9e0b-b4723bd5315e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45772024-12-21T07:49:48.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b080b87a-1828-4cae-bd01-4bda3e6277d5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45782024-12-21T07:49:48.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b080b87a-1828-4cae-bd01-4bda3e6277d5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45792024-12-21T07:49:48.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b080b87a-1828-4cae-bd01-4bda3e6277d5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45802024-12-21T07:49:49.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 62eb07eb-77c7-4c23-961c-461b27dd7934 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45812024-12-21T07:49:49.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 62eb07eb-77c7-4c23-961c-461b27dd7934 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45822024-12-21T07:49:49.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2760 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 62eb07eb-77c7-4c23-961c-461b27dd7934 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
45832024-12-21T07:49:49.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1501 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = b9c69201-180f-4abd-90f6-a5dda34b0bf3 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
45842024-12-21T07:49:50.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
45852024-12-21T07:49:50.665ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
45862024-12-21T07:49:50.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45872024-12-21T07:49:50.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45882024-12-21T07:49:50.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45892024-12-21T07:49:50.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45902024-12-21T07:49:50.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45912024-12-21T07:49:50.668ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45922024-12-21T07:49:50.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45932024-12-21T07:49:50.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.292012ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45942024-12-21T07:49:50.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45952024-12-21T07:49:50.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45962024-12-21T07:49:50.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45972024-12-21T07:49:50.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45982024-12-21T07:49:50.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45992024-12-21T07:49:50.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46002024-12-21T07:49:50.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
46012024-12-21T07:49:50.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46022024-12-21T07:49:50.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46032024-12-21T07:49:50.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f3f07d5e-f619-4b84-9848-b97683a4054b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46042024-12-21T07:49:50.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f3f07d5e-f619-4b84-9848-b97683a4054b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46052024-12-21T07:49:50.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1746 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f3f07d5e-f619-4b84-9848-b97683a4054b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46062024-12-21T07:49:50.684ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
46072024-12-21T07:49:50.684ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.975066ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
46082024-12-21T07:49:51.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 606a7fd1-77b0-439d-b101-c9ce9555b0f8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46092024-12-21T07:49:51.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 606a7fd1-77b0-439d-b101-c9ce9555b0f8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46102024-12-21T07:49:51.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 606a7fd1-77b0-439d-b101-c9ce9555b0f8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46112024-12-21T07:49:52.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9c27f802-5f07-48cf-857b-9ffbb2c31e64 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46122024-12-21T07:49:52.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9c27f802-5f07-48cf-857b-9ffbb2c31e64 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46132024-12-21T07:49:52.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9c27f802-5f07-48cf-857b-9ffbb2c31e64 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46142024-12-21T07:49:53.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = db184fa8-ca77-4588-a273-108ee1089914 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46152024-12-21T07:49:53.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = db184fa8-ca77-4588-a273-108ee1089914 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46162024-12-21T07:49:53.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = db184fa8-ca77-4588-a273-108ee1089914 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46172024-12-21T07:49:54.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9bd85e9d-8dd5-42a3-bc4a-8e6f786091e1 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46182024-12-21T07:49:54.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9bd85e9d-8dd5-42a3-bc4a-8e6f786091e1 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46192024-12-21T07:49:54.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9bd85e9d-8dd5-42a3-bc4a-8e6f786091e1 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46202024-12-21T07:49:55.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e16bd7bf-61fb-435a-b38f-925633346870 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46212024-12-21T07:49:55.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e16bd7bf-61fb-435a-b38f-925633346870 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46222024-12-21T07:49:55.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2423 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e16bd7bf-61fb-435a-b38f-925633346870 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46232024-12-21T07:49:56.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9e5f335b-b566-4fa6-8e13-0930895a5d87 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46242024-12-21T07:49:56.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9e5f335b-b566-4fa6-8e13-0930895a5d87 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46252024-12-21T07:49:56.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9e5f335b-b566-4fa6-8e13-0930895a5d87 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46262024-12-21T07:49:57.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4b483fa9-41be-44ba-bcc7-bbec70a05c83 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46272024-12-21T07:49:57.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4b483fa9-41be-44ba-bcc7-bbec70a05c83 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46282024-12-21T07:49:57.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4b483fa9-41be-44ba-bcc7-bbec70a05c83 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46292024-12-21T07:49:58.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 02329bdc-db20-4fad-b4de-d98cf240513a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46302024-12-21T07:49:58.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 02329bdc-db20-4fad-b4de-d98cf240513a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46312024-12-21T07:49:58.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 02329bdc-db20-4fad-b4de-d98cf240513a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46322024-12-21T07:49:59.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1326 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 8625662d-887c-4491-b3a0-7f83d7972e3c response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
46332024-12-21T07:49:59.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 05acf57f-3c6a-42c3-96ed-71c171ebe3ce roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46342024-12-21T07:49:59.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 05acf57f-3c6a-42c3-96ed-71c171ebe3ce resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46352024-12-21T07:49:59.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1769 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 05acf57f-3c6a-42c3-96ed-71c171ebe3ce response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
46362024-12-21T07:50:00.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = f0fc96c5-f764-484f-ac34-37d4f74b1f0e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
46372024-12-21T07:50:00.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = f0fc96c5-f764-484f-ac34-37d4f74b1f0e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
46382024-12-21T07:50:00.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3875 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = f0fc96c5-f764-484f-ac34-37d4f74b1f0e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
46392024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
46402024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
46412024-12-21T07:50:00.666ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
46422024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
46432024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
46442024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
46452024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
46462024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
46472024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46482024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
46492024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46502024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
46512024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46522024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
46532024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
46542024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46552024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
46562024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46572024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46582024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
46592024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46602024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
46612024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46622024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
46632024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
46642024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
46652024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
46662024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46672024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
46682024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
46692024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46702024-12-21T07:50:00.666ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:40:00.666569682 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
46712024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
46722024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
46732024-12-21T07:50:00.666ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46742024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
46752024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46762024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
46772024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
46782024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
46792024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46802024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
46812024-12-21T07:50:00.666ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b
46822024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.99\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b"}
46832024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
46842024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46852024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
46862024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46872024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
46882024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46892024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
46902024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
46912024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46922024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
46932024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
46942024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
46952024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46962024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46972024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
46982024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46992024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
47002024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
47012024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47022024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
47032024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
47042024-12-21T07:50:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
47052024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47062024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
47072024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47082024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47092024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47102024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47112024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47122024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47132024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47142024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47152024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47162024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
47172024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47182024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
47192024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
47202024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
47212024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47222024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47232024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47242024-12-21T07:50:00.667ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dd95bbd-e009-486c-8c96-451a6e195a49.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1334, tv_nsec: 366938100 } })
47252024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47262024-12-21T07:50:00.667ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bfae345-1659-4377-bca9-c55abec2aeb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7c426166-4f75-4a87-b9ac-c0d590aea49b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1334, tv_nsec: 366964421 } })
47272024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
47282024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.393143ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
47292024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
47302024-12-21T07:50:00.667ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.303601ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
47312024-12-21T07:50:00.668ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47322024-12-21T07:50:00.669ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47332024-12-21T07:50:00.670ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.102058ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
47342024-12-21T07:50:00.670ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47352024-12-21T07:50:00.670ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47362024-12-21T07:50:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47372024-12-21T07:50:00.671ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1334, tv_nsec: 370738344 } })
47382024-12-21T07:50:00.671ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1334, tv_nsec: 370747513 } })
47392024-12-21T07:50:00.671ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
47402024-12-21T07:50:00.671ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
47412024-12-21T07:50:00.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
47422024-12-21T07:50:00.672ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
47432024-12-21T07:50:00.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
47442024-12-21T07:50:00.672ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.03707ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
47452024-12-21T07:50:00.673ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47462024-12-21T07:50:00.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47472024-12-21T07:50:00.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47482024-12-21T07:50:00.675ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47492024-12-21T07:50:00.675ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47502024-12-21T07:50:00.676ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47512024-12-21T07:50:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47522024-12-21T07:50:00.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47532024-12-21T07:50:00.678ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47542024-12-21T07:50:00.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47552024-12-21T07:50:00.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47562024-12-21T07:50:00.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47572024-12-21T07:50:00.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47582024-12-21T07:50:00.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47592024-12-21T07:50:00.678ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47602024-12-21T07:50:00.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47612024-12-21T07:50:00.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47622024-12-21T07:50:00.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47632024-12-21T07:50:00.680ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47642024-12-21T07:50:00.682ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47652024-12-21T07:50:00.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47662024-12-21T07:50:00.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47672024-12-21T07:50:00.682ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:40:00.666569682 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
47682024-12-21T07:50:00.682ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.62356ms iteration = 8 status = {"expiration":"2024-12-21T07:40:00.666569682Z","pruned":[]}
47692024-12-21T07:50:00.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47702024-12-21T07:50:00.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47712024-12-21T07:50:00.683ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
47722024-12-21T07:50:00.683ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
47732024-12-21T07:50:00.683ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 17.386249ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
47742024-12-21T07:50:00.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47752024-12-21T07:50:00.686ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47762024-12-21T07:50:00.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 19.84621ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47772024-12-21T07:50:00.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47782024-12-21T07:50:00.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47792024-12-21T07:50:00.688ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47802024-12-21T07:50:00.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47812024-12-21T07:50:00.690ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47822024-12-21T07:50:00.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47832024-12-21T07:50:00.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47842024-12-21T07:50:00.691ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47852024-12-21T07:50:00.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1334, tv_nsec: 391470768 } })
47862024-12-21T07:50:00.692ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
47872024-12-21T07:50:00.695ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47882024-12-21T07:50:00.695ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47892024-12-21T07:50:00.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47902024-12-21T07:50:00.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
47912024-12-21T07:50:00.699ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47922024-12-21T07:50:00.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47932024-12-21T07:50:00.713ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.074894ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
47942024-12-21T07:50:00.722ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47952024-12-21T07:50:00.722ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47962024-12-21T07:50:00.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47972024-12-21T07:50:00.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47982024-12-21T07:50:00.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47992024-12-21T07:50:00.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48002024-12-21T07:50:00.730ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48012024-12-21T07:50:00.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48022024-12-21T07:50:00.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48032024-12-21T07:50:00.734ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 68.270186ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
48042024-12-21T07:50:00.736ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.358654ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
48052024-12-21T07:50:00.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48062024-12-21T07:50:00.737ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
48072024-12-21T07:50:00.737ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
48082024-12-21T07:50:00.737ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 70.834298ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
48092024-12-21T07:50:00.738ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48102024-12-21T07:50:00.738ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48112024-12-21T07:50:00.738ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
48122024-12-21T07:50:00.738ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
48132024-12-21T07:50:00.738ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
48142024-12-21T07:50:00.738ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48152024-12-21T07:50:00.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48162024-12-21T07:50:00.738ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48172024-12-21T07:50:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48182024-12-21T07:50:00.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48192024-12-21T07:50:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48202024-12-21T07:50:00.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48212024-12-21T07:50:00.740ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48222024-12-21T07:50:00.740ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
48232024-12-21T07:50:00.740ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 74.082083ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
48242024-12-21T07:50:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48252024-12-21T07:50:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48262024-12-21T07:50:00.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
48272024-12-21T07:50:00.742ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48282024-12-21T07:50:00.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48292024-12-21T07:50:00.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
48302024-12-21T07:50:00.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48312024-12-21T07:50:00.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48322024-12-21T07:50:00.744ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
48332024-12-21T07:50:00.744ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
48342024-12-21T07:50:00.744ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
48352024-12-21T07:50:00.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48362024-12-21T07:50:00.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48372024-12-21T07:50:00.755ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
48382024-12-21T07:50:00.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
48392024-12-21T07:50:00.755ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48402024-12-21T07:50:00.755ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
48412024-12-21T07:50:00.755ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48422024-12-21T07:50:00.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48432024-12-21T07:50:00.875ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
48442024-12-21T07:50:00.875ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48452024-12-21T07:50:00.876ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3d684f6-dafd-4839-ad7f-24a5b2ae7902", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:00 GMT"} })
48462024-12-21T07:50:00.876ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48472024-12-21T07:50:00.878ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48482024-12-21T07:50:00.890ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
48492024-12-21T07:50:00.890ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48502024-12-21T07:50:00.890ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6b0eea5-6220-4621-adb5-c2c5ba718b68", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:00 GMT"} })
48512024-12-21T07:50:00.890ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48522024-12-21T07:50:00.892ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
48532024-12-21T07:50:00.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c23577b8-b53a-46f7-b4ea-cf63784228aa roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
48542024-12-21T07:50:00.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c23577b8-b53a-46f7-b4ea-cf63784228aa resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
48552024-12-21T07:50:00.955ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
48562024-12-21T07:50:00.994ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
48572024-12-21T07:50:00.994ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48582024-12-21T07:50:00.994ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ce76893-fbfd-4b35-b261-dba65748fdf3", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:00 GMT"} })
48592024-12-21T07:50:00.994ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48602024-12-21T07:50:00.996ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48612024-12-21T07:50:01.003ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
48622024-12-21T07:50:01.039ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48632024-12-21T07:50:01.039ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48642024-12-21T07:50:01.039ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "744d4a2f-e797-45a6-93a9-b8e688f92f6b", "content-length": "372", "date": "Sat, 21 Dec 2024 07:50:00 GMT"} })
48652024-12-21T07:50:01.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48662024-12-21T07:50:01.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48672024-12-21T07:50:01.041ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48682024-12-21T07:50:01.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48692024-12-21T07:50:01.041ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 374.888557ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
48702024-12-21T07:50:01.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48712024-12-21T07:50:01.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48722024-12-21T07:50:01.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48732024-12-21T07:50:01.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48742024-12-21T07:50:01.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48752024-12-21T07:50:01.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148900 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c23577b8-b53a-46f7-b4ea-cf63784228aa response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
48762024-12-21T07:50:01.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48772024-12-21T07:50:01.049ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48782024-12-21T07:50:01.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48792024-12-21T07:50:01.066ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
48802024-12-21T07:50:01.066ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 399.812462ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
48812024-12-21T07:50:01.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48822024-12-21T07:50:01.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
48832024-12-21T07:50:01.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48842024-12-21T07:50:01.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48852024-12-21T07:50:01.092ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 425.945527ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
48862024-12-21T07:50:01.092ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48872024-12-21T07:50:01.093ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48882024-12-21T07:50:01.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48892024-12-21T07:50:01.093ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48902024-12-21T07:50:01.093ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
48912024-12-21T07:50:01.093ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 427.31556ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
48922024-12-21T07:50:01.094ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48932024-12-21T07:50:01.095ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48942024-12-21T07:50:01.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
48952024-12-21T07:50:01.097ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48962024-12-21T07:50:01.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48972024-12-21T07:50:01.097ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
48982024-12-21T07:50:01.097ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48992024-12-21T07:50:01.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49002024-12-21T07:50:01.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49012024-12-21T07:50:01.098ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49022024-12-21T07:50:01.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49032024-12-21T07:50:01.099ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
49042024-12-21T07:50:01.099ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 432.573388ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
49052024-12-21T07:50:01.099ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 433.134316ms iteration = 15 status = 0
49062024-12-21T07:50:01.109ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
49072024-12-21T07:50:01.109ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 0 version = 2
49082024-12-21T07:50:01.109ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49092024-12-21T07:50:01.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49102024-12-21T07:50:01.117ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
49112024-12-21T07:50:01.117ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
49122024-12-21T07:50:01.117ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49132024-12-21T07:50:01.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49142024-12-21T07:50:01.120ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
49152024-12-21T07:50:01.120ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
49162024-12-21T07:50:01.121ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "39abd89b-7c74-4ab5-9eb7-9460865dd312", "date": "Sat, 21 Dec 2024 07:50:01 GMT"} })
49172024-12-21T07:50:01.121ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49182024-12-21T07:50:01.121ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49192024-12-21T07:50:01.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49202024-12-21T07:50:01.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49212024-12-21T07:50:01.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49222024-12-21T07:50:01.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49232024-12-21T07:50:01.125ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49242024-12-21T07:50:01.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49252024-12-21T07:50:01.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49262024-12-21T07:50:01.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49272024-12-21T07:50:01.132ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
49282024-12-21T07:50:01.132ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
49292024-12-21T07:50:01.132ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:43:39.444085 UTC dns_group = internal generation = 1
49302024-12-21T07:50:01.132ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 466.004024ms iteration = 9 status = {"generation":1}
49312024-12-21T07:50:01.133ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
49322024-12-21T07:50:01.133ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49332024-12-21T07:50:01.133ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d769f8e9-1cba-45d6-beec-9e6420910df8", "date": "Sat, 21 Dec 2024 07:50:01 GMT"} })
49342024-12-21T07:50:01.135ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 468.429794ms iteration = 16 status = {}
49352024-12-21T07:50:01.138ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
49362024-12-21T07:50:01.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49372024-12-21T07:50:01.142ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:42:50.264108Z, time_modified: 2024-12-21T07:42:50.264108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }) }
49382024-12-21T07:50:01.142ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 475.673955ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]}},"default_endpoint":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
49392024-12-21T07:50:01.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49402024-12-21T07:50:01.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49412024-12-21T07:50:01.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49422024-12-21T07:50:01.144ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 1 version = 2
49432024-12-21T07:50:01.144ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
49442024-12-21T07:50:01.144ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:43:41.075205 UTC dns_group = external generation = 2
49452024-12-21T07:50:01.144ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 478.4063ms iteration = 9 status = {"generation":2}
49462024-12-21T07:50:01.154ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49472024-12-21T07:50:01.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49482024-12-21T07:50:01.169ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 503.05231ms iteration = 15 status = {}
49492024-12-21T07:50:01.178ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
49502024-12-21T07:50:01.178ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3789fada-fd6c-43bc-8ff6-8479f725802c", "date": "Sat, 21 Dec 2024 07:50:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49512024-12-21T07:50:01.178ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49522024-12-21T07:50:01.181ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0865e09b-a9ff-4d0c-8568-113147f6cf5d", "date": "Sat, 21 Dec 2024 07:50:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49532024-12-21T07:50:01.181ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49542024-12-21T07:50:01.183ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
49552024-12-21T07:50:01.183ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 516.87816ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
49562024-12-21T07:50:01.198ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49572024-12-21T07:50:01.201ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49582024-12-21T07:50:01.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49592024-12-21T07:50:01.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49602024-12-21T07:50:01.205ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 538.836265ms iteration = 18 status = {"physical_disks_added":0}
49612024-12-21T07:50:01.206ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
49622024-12-21T07:50:01.206ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "af25a6f7-90f3-4e00-a093-ce8fa520e9a2", "content-length": "1", "date": "Sat, 21 Dec 2024 07:50:00 GMT"} })
49632024-12-21T07:50:01.208ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49642024-12-21T07:50:01.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49652024-12-21T07:50:01.210ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 544.240746ms iteration = 15 status = null
49662024-12-21T07:50:01.224ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
49672024-12-21T07:50:01.225ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f0e4ddd9-8a13-48ba-8030-b4d473f5f911", "date": "Sat, 21 Dec 2024 07:50:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
49682024-12-21T07:50:01.225ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
49692024-12-21T07:50:01.227ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c8db2d40-af46-48ad-aee1-286e2946f797", "date": "Sat, 21 Dec 2024 07:50:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
49702024-12-21T07:50:01.227ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
49712024-12-21T07:50:01.229ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f0b65367-4db1-499c-835c-0c39f1053ca8", "date": "Sat, 21 Dec 2024 07:50:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
49722024-12-21T07:50:01.229ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
49732024-12-21T07:50:01.232ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
49742024-12-21T07:50:01.232ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 565.52987ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
49752024-12-21T07:50:01.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49762024-12-21T07:50:01.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49772024-12-21T07:50:01.251ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49782024-12-21T07:50:01.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49792024-12-21T07:50:01.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49802024-12-21T07:50:01.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49812024-12-21T07:50:01.289ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
49822024-12-21T07:50:01.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49832024-12-21T07:50:01.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49842024-12-21T07:50:01.310ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
49852024-12-21T07:50:01.310ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee0cff36-8e28-4462-8b72-f95828327dd8", "content-length": "134", "date": "Sat, 21 Dec 2024 07:50:00 GMT"} })
49862024-12-21T07:50:01.310ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
49872024-12-21T07:50:01.310ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
49882024-12-21T07:50:01.310ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
49892024-12-21T07:50:01.310ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
49902024-12-21T07:50:01.310ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49912024-12-21T07:50:01.310ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49922024-12-21T07:50:01.310ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49932024-12-21T07:50:01.310ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49942024-12-21T07:50:01.311ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49952024-12-21T07:50:01.311ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49962024-12-21T07:50:01.311ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
49972024-12-21T07:50:01.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49982024-12-21T07:50:01.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49992024-12-21T07:50:01.313ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
50002024-12-21T07:50:01.313ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3864fe96-14c4-4bb3-993d-c2b26a352080", "content-length": "2", "date": "Sat, 21 Dec 2024 07:50:00 GMT"} })
50012024-12-21T07:50:01.313ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
50022024-12-21T07:50:01.313ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9a31066-1fba-4883-a103-ce1bd98d6504", "content-length": "52", "date": "Sat, 21 Dec 2024 07:50:00 GMT"} })
50032024-12-21T07:50:01.313ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
50042024-12-21T07:50:01.313ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
50052024-12-21T07:50:01.345ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50062024-12-21T07:50:01.414ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "29b9648b-6285-4a26-ad60-1ac4b2ffe0ac", "date": "Sat, 21 Dec 2024 07:50:01 GMT"} })
50072024-12-21T07:50:01.414ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
50082024-12-21T07:50:01.414ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
50092024-12-21T07:50:01.414ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d23067cc-f3aa-4f2d-aa8e-ff6896aa5782", "content-length": "691", "date": "Sat, 21 Dec 2024 07:50:01 GMT"} })
50102024-12-21T07:50:01.414ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
50112024-12-21T07:50:01.414ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
50122024-12-21T07:50:01.414ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
50132024-12-21T07:50:01.414ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1a65eb3-837a-4fb1-bd55-d8e973892ade", "content-length": "682", "date": "Sat, 21 Dec 2024 07:50:01 GMT"} })
50142024-12-21T07:50:01.414ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50152024-12-21T07:50:01.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50162024-12-21T07:50:01.415ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 749.218866ms iteration = 15 status = {}
50172024-12-21T07:50:01.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50182024-12-21T07:50:01.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50192024-12-21T07:50:01.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50202024-12-21T07:50:01.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50212024-12-21T07:50:01.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50222024-12-21T07:50:01.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50232024-12-21T07:50:01.431ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 764.449489ms iteration = 15 status = {}
50242024-12-21T07:50:02.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5543772c-a65d-46cf-8206-b663fc2dfbf0 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50252024-12-21T07:50:02.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5543772c-a65d-46cf-8206-b663fc2dfbf0 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50262024-12-21T07:50:02.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2772 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5543772c-a65d-46cf-8206-b663fc2dfbf0 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50272024-12-21T07:50:03.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 10a63569-7d5d-4611-a077-ca170fd1e77b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50282024-12-21T07:50:03.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 10a63569-7d5d-4611-a077-ca170fd1e77b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50292024-12-21T07:50:03.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 10a63569-7d5d-4611-a077-ca170fd1e77b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50302024-12-21T07:50:04.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e3a47864-06a8-4897-948b-2d7629451775 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50312024-12-21T07:50:04.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e3a47864-06a8-4897-948b-2d7629451775 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50322024-12-21T07:50:04.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e3a47864-06a8-4897-948b-2d7629451775 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50332024-12-21T07:50:04.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 5c283080-1463-442c-aabd-540fc302b0c2 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
50342024-12-21T07:50:04.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 5c283080-1463-442c-aabd-540fc302b0c2 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
50352024-12-21T07:50:04.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 5c283080-1463-442c-aabd-540fc302b0c2 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
50362024-12-21T07:50:04.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 2073f26a-ac81-4816-8679-1346b3bf9144 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
50372024-12-21T07:50:04.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 2073f26a-ac81-4816-8679-1346b3bf9144 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
50382024-12-21T07:50:04.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 2073f26a-ac81-4816-8679-1346b3bf9144 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
50392024-12-21T07:50:05.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ecb22abd-4fa0-4140-8a6d-5093cc291194 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50402024-12-21T07:50:05.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ecb22abd-4fa0-4140-8a6d-5093cc291194 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50412024-12-21T07:50:05.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ecb22abd-4fa0-4140-8a6d-5093cc291194 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50422024-12-21T07:50:06.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2d5b0494-01be-450d-987e-cbb9a10041f0 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50432024-12-21T07:50:06.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2d5b0494-01be-450d-987e-cbb9a10041f0 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50442024-12-21T07:50:06.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2d5b0494-01be-450d-987e-cbb9a10041f0 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50452024-12-21T07:50:07.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 72b017e8-eae8-4309-8c01-47a734bbd4a7 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50462024-12-21T07:50:07.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 72b017e8-eae8-4309-8c01-47a734bbd4a7 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50472024-12-21T07:50:07.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 72b017e8-eae8-4309-8c01-47a734bbd4a7 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50482024-12-21T07:50:08.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fc1cadc5-a30f-4d81-9bcf-0cf1e59cae34 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50492024-12-21T07:50:08.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fc1cadc5-a30f-4d81-9bcf-0cf1e59cae34 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50502024-12-21T07:50:08.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fc1cadc5-a30f-4d81-9bcf-0cf1e59cae34 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50512024-12-21T07:50:09.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4d18a753-6531-4c35-9c80-183e1fbd54a8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50522024-12-21T07:50:09.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4d18a753-6531-4c35-9c80-183e1fbd54a8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50532024-12-21T07:50:09.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4d18a753-6531-4c35-9c80-183e1fbd54a8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50542024-12-21T07:50:09.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1527 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 1e172233-a3b7-4db4-a0a7-826842d022a6 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
50552024-12-21T07:50:10.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1a99ad2b-3621-48a1-8b02-652b53477db8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50562024-12-21T07:50:10.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1a99ad2b-3621-48a1-8b02-652b53477db8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50572024-12-21T07:50:10.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1a99ad2b-3621-48a1-8b02-652b53477db8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50582024-12-21T07:50:10.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
50592024-12-21T07:50:10.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
50602024-12-21T07:50:10.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50612024-12-21T07:50:10.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50622024-12-21T07:50:10.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50632024-12-21T07:50:10.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50642024-12-21T07:50:10.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50652024-12-21T07:50:10.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50662024-12-21T07:50:10.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50672024-12-21T07:50:10.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50682024-12-21T07:50:10.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50692024-12-21T07:50:10.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50702024-12-21T07:50:10.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50712024-12-21T07:50:10.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
50722024-12-21T07:50:10.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50732024-12-21T07:50:10.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50742024-12-21T07:50:10.688ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
50752024-12-21T07:50:10.688ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.522294ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
50762024-12-21T07:50:10.695ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50772024-12-21T07:50:10.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50782024-12-21T07:50:10.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.281971ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50792024-12-21T07:50:11.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 83b29e25-101a-4f88-bdf9-9648bf5efa3c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50802024-12-21T07:50:11.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 83b29e25-101a-4f88-bdf9-9648bf5efa3c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50812024-12-21T07:50:11.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 83b29e25-101a-4f88-bdf9-9648bf5efa3c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50822024-12-21T07:50:12.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2e5022f-f816-4b48-8d31-ad649ded8658 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50832024-12-21T07:50:12.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2e5022f-f816-4b48-8d31-ad649ded8658 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50842024-12-21T07:50:12.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1737 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2e5022f-f816-4b48-8d31-ad649ded8658 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50852024-12-21T07:50:13.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fd709ffe-6d0a-4461-bbe1-56acd105ffe1 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50862024-12-21T07:50:13.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fd709ffe-6d0a-4461-bbe1-56acd105ffe1 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50872024-12-21T07:50:13.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fd709ffe-6d0a-4461-bbe1-56acd105ffe1 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50882024-12-21T07:50:14.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 22519880-fbd2-41b4-b6e3-a52109da3587 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50892024-12-21T07:50:14.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 22519880-fbd2-41b4-b6e3-a52109da3587 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50902024-12-21T07:50:14.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 22519880-fbd2-41b4-b6e3-a52109da3587 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50912024-12-21T07:50:15.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9cd75f19-e554-4d7e-953e-970c04bcfb96 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50922024-12-21T07:50:15.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9cd75f19-e554-4d7e-953e-970c04bcfb96 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50932024-12-21T07:50:15.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9cd75f19-e554-4d7e-953e-970c04bcfb96 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50942024-12-21T07:50:16.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = aac73cc3-6aa6-49ec-a833-ee27f4fb844f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50952024-12-21T07:50:16.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = aac73cc3-6aa6-49ec-a833-ee27f4fb844f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50962024-12-21T07:50:16.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = aac73cc3-6aa6-49ec-a833-ee27f4fb844f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50972024-12-21T07:50:17.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6714a78f-477c-4baa-b146-3c3a46592b95 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50982024-12-21T07:50:17.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6714a78f-477c-4baa-b146-3c3a46592b95 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
50992024-12-21T07:50:17.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6714a78f-477c-4baa-b146-3c3a46592b95 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51002024-12-21T07:50:18.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eb9e6e5a-e447-4df0-80f0-1d9a8a483997 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51012024-12-21T07:50:18.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eb9e6e5a-e447-4df0-80f0-1d9a8a483997 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51022024-12-21T07:50:18.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eb9e6e5a-e447-4df0-80f0-1d9a8a483997 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51032024-12-21T07:50:19.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0d166473-fd09-42c9-960f-b6841e149822 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51042024-12-21T07:50:19.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0d166473-fd09-42c9-960f-b6841e149822 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51052024-12-21T07:50:19.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0d166473-fd09-42c9-960f-b6841e149822 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51062024-12-21T07:50:19.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = d616a296-50d3-463d-951f-ffc3eb1610af roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
51072024-12-21T07:50:19.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = d616a296-50d3-463d-951f-ffc3eb1610af resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
51082024-12-21T07:50:19.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = d616a296-50d3-463d-951f-ffc3eb1610af response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
51092024-12-21T07:50:19.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 71dc6612-7709-43f6-a848-491bd599353a roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
51102024-12-21T07:50:19.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 71dc6612-7709-43f6-a848-491bd599353a resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
51112024-12-21T07:50:19.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 71dc6612-7709-43f6-a848-491bd599353a response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
51122024-12-21T07:50:19.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1234 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = f0a9d95f-8bd5-4461-b7ef-5aa073da77b6 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
51132024-12-21T07:50:20.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f01f55a9-c9ae-4e74-81bc-b87f71c7d22f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51142024-12-21T07:50:20.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f01f55a9-c9ae-4e74-81bc-b87f71c7d22f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51152024-12-21T07:50:20.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f01f55a9-c9ae-4e74-81bc-b87f71c7d22f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51162024-12-21T07:50:20.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
51172024-12-21T07:50:20.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
51182024-12-21T07:50:20.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51192024-12-21T07:50:20.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51202024-12-21T07:50:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51212024-12-21T07:50:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51222024-12-21T07:50:20.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51232024-12-21T07:50:20.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51242024-12-21T07:50:20.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51252024-12-21T07:50:20.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51262024-12-21T07:50:20.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51272024-12-21T07:50:20.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51282024-12-21T07:50:20.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51292024-12-21T07:50:20.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
51302024-12-21T07:50:20.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51312024-12-21T07:50:20.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51322024-12-21T07:50:20.689ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
51332024-12-21T07:50:20.689ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.016302ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
51342024-12-21T07:50:20.693ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51352024-12-21T07:50:20.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51362024-12-21T07:50:20.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.012772ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51372024-12-21T07:50:21.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 172937ff-3faf-4fc2-a790-eb4ba0553031 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51382024-12-21T07:50:21.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 172937ff-3faf-4fc2-a790-eb4ba0553031 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51392024-12-21T07:50:21.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 172937ff-3faf-4fc2-a790-eb4ba0553031 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51402024-12-21T07:50:22.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2ffe8c67-fda7-46fb-8262-8826730eb29b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51412024-12-21T07:50:22.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2ffe8c67-fda7-46fb-8262-8826730eb29b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51422024-12-21T07:50:22.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2ffe8c67-fda7-46fb-8262-8826730eb29b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51432024-12-21T07:50:23.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 028fb063-e2c8-42a3-a99d-ef7214edf84f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51442024-12-21T07:50:23.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 028fb063-e2c8-42a3-a99d-ef7214edf84f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51452024-12-21T07:50:23.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 028fb063-e2c8-42a3-a99d-ef7214edf84f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51462024-12-21T07:50:24.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c847a3e7-3c04-492d-aa83-48baf6ff5134 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51472024-12-21T07:50:24.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c847a3e7-3c04-492d-aa83-48baf6ff5134 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51482024-12-21T07:50:24.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c847a3e7-3c04-492d-aa83-48baf6ff5134 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51492024-12-21T07:50:25.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7a09732-01f5-4f8f-82f6-5a92761ac061 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51502024-12-21T07:50:25.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7a09732-01f5-4f8f-82f6-5a92761ac061 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51512024-12-21T07:50:25.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7a09732-01f5-4f8f-82f6-5a92761ac061 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51522024-12-21T07:50:26.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 309fb377-f985-421f-9157-c456d20ea2d5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51532024-12-21T07:50:26.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 309fb377-f985-421f-9157-c456d20ea2d5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51542024-12-21T07:50:26.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 309fb377-f985-421f-9157-c456d20ea2d5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51552024-12-21T07:50:27.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7f331355-3ea0-491a-97da-7e795e763c24 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51562024-12-21T07:50:27.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7f331355-3ea0-491a-97da-7e795e763c24 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51572024-12-21T07:50:27.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7f331355-3ea0-491a-97da-7e795e763c24 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51582024-12-21T07:50:28.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6568f715-4cbc-40af-9f48-8913818de687 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51592024-12-21T07:50:28.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6568f715-4cbc-40af-9f48-8913818de687 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51602024-12-21T07:50:28.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6568f715-4cbc-40af-9f48-8913818de687 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51612024-12-21T07:50:29.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7d054d5-0067-43ff-89ba-0c76d772aca4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51622024-12-21T07:50:29.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7d054d5-0067-43ff-89ba-0c76d772aca4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51632024-12-21T07:50:29.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7d054d5-0067-43ff-89ba-0c76d772aca4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
51642024-12-21T07:50:29.742ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1357 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 851625c5-08a4-4ee3-b190-233f79739e13 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
51652024-12-21T07:50:30.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = ec24c0af-82ca-4809-919d-420036251cb1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
51662024-12-21T07:50:30.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = ec24c0af-82ca-4809-919d-420036251cb1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
51672024-12-21T07:50:30.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = ec24c0af-82ca-4809-919d-420036251cb1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
51682024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
51692024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
51702024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
51712024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
51722024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51732024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
51742024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51752024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51762024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
51772024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
51782024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
51792024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51802024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51812024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
51822024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
51832024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
51842024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51852024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51862024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51872024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
51882024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
51892024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
51902024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
51912024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51922024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
51932024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51942024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
51952024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51962024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
51972024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
51982024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
51992024-12-21T07:50:30.666ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52002024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
52012024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52022024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52032024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52042024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52052024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
52062024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52072024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52082024-12-21T07:50:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52092024-12-21T07:50:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52102024-12-21T07:50:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52112024-12-21T07:50:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52122024-12-21T07:50:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52132024-12-21T07:50:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52142024-12-21T07:50:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
52152024-12-21T07:50:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52162024-12-21T07:50:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52172024-12-21T07:50:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52182024-12-21T07:50:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52192024-12-21T07:50:30.668ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52202024-12-21T07:50:30.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52212024-12-21T07:50:30.669ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52222024-12-21T07:50:30.669ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.962539ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
52232024-12-21T07:50:30.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.272185ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
52242024-12-21T07:50:30.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52252024-12-21T07:50:30.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 635d1c25-fa54-4415-b150-987e21dbaf4f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
52262024-12-21T07:50:30.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 635d1c25-fa54-4415-b150-987e21dbaf4f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
52272024-12-21T07:50:30.670ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52282024-12-21T07:50:30.670ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 370464670 } })
52292024-12-21T07:50:30.671ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
52302024-12-21T07:50:30.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52312024-12-21T07:50:30.671ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52322024-12-21T07:50:30.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52332024-12-21T07:50:30.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
52342024-12-21T07:50:30.672ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52352024-12-21T07:50:30.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52362024-12-21T07:50:30.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
52372024-12-21T07:50:30.672ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52382024-12-21T07:50:30.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52392024-12-21T07:50:30.673ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52402024-12-21T07:50:30.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52412024-12-21T07:50:30.674ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52422024-12-21T07:50:30.674ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
52432024-12-21T07:50:30.674ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52442024-12-21T07:50:30.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52452024-12-21T07:50:30.674ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.046373ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
52462024-12-21T07:50:30.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
52472024-12-21T07:50:30.675ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52482024-12-21T07:50:30.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52492024-12-21T07:50:30.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52502024-12-21T07:50:30.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52512024-12-21T07:50:30.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52522024-12-21T07:50:30.677ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52532024-12-21T07:50:30.678ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 377715010 } })
52542024-12-21T07:50:30.678ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
52552024-12-21T07:50:30.678ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.176433ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52562024-12-21T07:50:30.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 635d1c25-fa54-4415-b150-987e21dbaf4f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
52572024-12-21T07:50:30.679ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52582024-12-21T07:50:30.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52592024-12-21T07:50:30.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52602024-12-21T07:50:30.680ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52612024-12-21T07:50:30.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52622024-12-21T07:50:30.681ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1364, tv_nsec: 381417772 } })
52632024-12-21T07:50:30.682ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
52642024-12-21T07:50:30.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52652024-12-21T07:50:30.682ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52662024-12-21T07:50:30.682ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52672024-12-21T07:50:30.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52682024-12-21T07:50:30.682ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52692024-12-21T07:50:30.682ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52702024-12-21T07:50:30.682ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52712024-12-21T07:50:30.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52722024-12-21T07:50:30.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52732024-12-21T07:50:30.683ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52742024-12-21T07:50:30.683ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52752024-12-21T07:50:30.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52762024-12-21T07:50:30.686ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
52772024-12-21T07:50:30.686ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.604717ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
52782024-12-21T07:50:30.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52792024-12-21T07:50:30.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52802024-12-21T07:50:30.711ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52812024-12-21T07:50:30.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52822024-12-21T07:50:30.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52832024-12-21T07:50:30.713ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52842024-12-21T07:50:30.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52852024-12-21T07:50:30.713ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52862024-12-21T07:50:30.714ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52872024-12-21T07:50:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52882024-12-21T07:50:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52892024-12-21T07:50:30.714ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52902024-12-21T07:50:30.714ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 48.347225ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52912024-12-21T07:50:30.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
52922024-12-21T07:50:30.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52932024-12-21T07:50:30.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52942024-12-21T07:50:30.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52952024-12-21T07:50:30.716ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52962024-12-21T07:50:30.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52972024-12-21T07:50:30.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52982024-12-21T07:50:30.718ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 51.624279ms iteration = 16 status = 0
52992024-12-21T07:50:30.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
53002024-12-21T07:50:30.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53012024-12-21T07:50:30.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53022024-12-21T07:50:30.724ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 58.150188ms iteration = 19 status = {"physical_disks_added":0}
53032024-12-21T07:50:30.727ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53042024-12-21T07:50:30.727ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
53052024-12-21T07:50:30.727ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 60.980984ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
53062024-12-21T07:50:30.730ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
53072024-12-21T07:50:30.730ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.205058ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
53082024-12-21T07:50:30.744ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53092024-12-21T07:50:30.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53102024-12-21T07:50:30.747ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 80.769364ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
53112024-12-21T07:50:30.751ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
53122024-12-21T07:50:30.751ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53132024-12-21T07:50:30.751ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9eb0b4f0-46f3-4c82-9463-279c4f1e2c9e", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:29 GMT"} })
53142024-12-21T07:50:30.751ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53152024-12-21T07:50:30.753ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53162024-12-21T07:50:30.756ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53172024-12-21T07:50:30.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53182024-12-21T07:50:30.762ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
53192024-12-21T07:50:30.762ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53202024-12-21T07:50:30.762ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "95cd40bc-6a47-43d5-be80-312bf0909d49", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:29 GMT"} })
53212024-12-21T07:50:30.762ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53222024-12-21T07:50:30.764ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53232024-12-21T07:50:30.765ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
53242024-12-21T07:50:30.765ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53252024-12-21T07:50:30.765ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d01bf42-f371-4394-96c1-9fbb27917d47", "content-length": "26", "date": "Sat, 21 Dec 2024 07:50:30 GMT"} })
53262024-12-21T07:50:30.765ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53272024-12-21T07:50:30.767ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
53282024-12-21T07:50:30.852ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
53292024-12-21T07:50:30.852ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53302024-12-21T07:50:30.853ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c32818e-08ad-49db-9469-fcd4d583085c", "content-length": "372", "date": "Sat, 21 Dec 2024 07:50:29 GMT"} })
53312024-12-21T07:50:30.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53322024-12-21T07:50:30.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53332024-12-21T07:50:30.857ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
53342024-12-21T07:50:30.857ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "85ad96e6-bcc1-450a-a4c9-b68883bd9923", "content-length": "1", "date": "Sat, 21 Dec 2024 07:50:30 GMT"} })
53352024-12-21T07:50:30.859ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53362024-12-21T07:50:30.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53372024-12-21T07:50:30.861ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 194.997205ms iteration = 16 status = null
53382024-12-21T07:50:30.869ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 202.729673ms iteration = 16 status = {}
53392024-12-21T07:50:30.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 220.058632ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
53402024-12-21T07:50:30.903ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
53412024-12-21T07:50:30.903ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
53422024-12-21T07:50:30.903ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6e24b300-acc2-49ea-a070-2988658e616c", "date": "Sat, 21 Dec 2024 07:50:30 GMT"} })
53432024-12-21T07:50:30.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53442024-12-21T07:50:30.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53452024-12-21T07:50:30.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53462024-12-21T07:50:30.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53472024-12-21T07:50:30.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53482024-12-21T07:50:30.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53492024-12-21T07:50:30.913ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
53502024-12-21T07:50:30.913ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53512024-12-21T07:50:30.913ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "58fe004b-3d98-4718-b5f2-c15e94347957", "date": "Sat, 21 Dec 2024 07:50:30 GMT"} })
53522024-12-21T07:50:30.915ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 248.689688ms iteration = 17 status = {}
53532024-12-21T07:50:30.933ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53542024-12-21T07:50:30.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53552024-12-21T07:50:30.936ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
53562024-12-21T07:50:30.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53572024-12-21T07:50:30.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53582024-12-21T07:50:30.947ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
53592024-12-21T07:50:30.947ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb66b78a-ac74-4451-b6d6-f08ffe4c9b76", "content-length": "134", "date": "Sat, 21 Dec 2024 07:50:30 GMT"} })
53602024-12-21T07:50:30.947ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
53612024-12-21T07:50:30.947ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
53622024-12-21T07:50:30.947ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
53632024-12-21T07:50:30.947ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
53642024-12-21T07:50:30.947ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53652024-12-21T07:50:30.947ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53662024-12-21T07:50:30.947ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53672024-12-21T07:50:30.947ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53682024-12-21T07:50:30.947ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53692024-12-21T07:50:30.947ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53702024-12-21T07:50:30.948ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
53712024-12-21T07:50:30.948ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53722024-12-21T07:50:30.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53732024-12-21T07:50:30.950ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
53742024-12-21T07:50:30.950ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "964a053f-b61b-4846-b7fa-ec4d2300cb76", "content-length": "2", "date": "Sat, 21 Dec 2024 07:50:30 GMT"} })
53752024-12-21T07:50:30.950ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
53762024-12-21T07:50:30.950ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "59016240-f73f-45c9-9cb7-10b8dfbdd5eb", "content-length": "52", "date": "Sat, 21 Dec 2024 07:50:30 GMT"} })
53772024-12-21T07:50:30.950ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
53782024-12-21T07:50:30.950ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
53792024-12-21T07:50:30.953ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53802024-12-21T07:50:30.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53812024-12-21T07:50:30.983ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53822024-12-21T07:50:30.985ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53832024-12-21T07:50:30.985ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53842024-12-21T07:50:30.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53852024-12-21T07:50:30.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53862024-12-21T07:50:30.989ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53872024-12-21T07:50:30.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53882024-12-21T07:50:30.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53892024-12-21T07:50:31.052ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d9ad8ac2-a4ed-4d7a-bf32-0870859909c5", "date": "Sat, 21 Dec 2024 07:50:30 GMT"} })
53902024-12-21T07:50:31.052ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
53912024-12-21T07:50:31.052ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
53922024-12-21T07:50:31.052ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8029682b-dacb-4e2b-869f-f735b9b877c4", "content-length": "682", "date": "Sat, 21 Dec 2024 07:50:31 GMT"} })
53932024-12-21T07:50:31.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53942024-12-21T07:50:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53952024-12-21T07:50:31.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53962024-12-21T07:50:31.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53972024-12-21T07:50:31.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53982024-12-21T07:50:31.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53992024-12-21T07:50:31.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54002024-12-21T07:50:31.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54012024-12-21T07:50:31.071ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 404.893937ms iteration = 16 status = {}
54022024-12-21T07:50:31.076ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54032024-12-21T07:50:31.163ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7ef4b91-e208-42e9-a7b8-0bb12a080a76", "content-length": "691", "date": "Sat, 21 Dec 2024 07:50:30 GMT"} })
54042024-12-21T07:50:31.163ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
54052024-12-21T07:50:31.163ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
54062024-12-21T07:50:31.163ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
54072024-12-21T07:50:31.166ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 499.566192ms iteration = 16 status = {}
54082024-12-21T07:50:31.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3c52e804-e6f7-4cb6-817a-2ff17cd4a13d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54092024-12-21T07:50:31.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3c52e804-e6f7-4cb6-817a-2ff17cd4a13d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54102024-12-21T07:50:31.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3c52e804-e6f7-4cb6-817a-2ff17cd4a13d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54112024-12-21T07:50:32.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 901cc4cf-c6dd-41cd-b610-ab6afae1eea8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54122024-12-21T07:50:32.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 901cc4cf-c6dd-41cd-b610-ab6afae1eea8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54132024-12-21T07:50:32.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 901cc4cf-c6dd-41cd-b610-ab6afae1eea8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54142024-12-21T07:50:33.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4e245772-c001-49f6-9bd0-c40460ad8b79 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54152024-12-21T07:50:33.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4e245772-c001-49f6-9bd0-c40460ad8b79 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54162024-12-21T07:50:33.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4e245772-c001-49f6-9bd0-c40460ad8b79 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54172024-12-21T07:50:34.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 135fdb37-372a-4e45-87d3-3cbf08e52389 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54182024-12-21T07:50:34.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 135fdb37-372a-4e45-87d3-3cbf08e52389 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54192024-12-21T07:50:34.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 135fdb37-372a-4e45-87d3-3cbf08e52389 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54202024-12-21T07:50:35.097ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:47196
54212024-12-21T07:50:35.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47196 req_id = 950587a6-e3a0-44f0-8e6e-d0013e913aad roles = RoleSet { roles: {} } uri = /metrics/producers
54222024-12-21T07:50:35.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47196 req_id = 950587a6-e3a0-44f0-8e6e-d0013e913aad resource = Database result = Ok(()) uri = /metrics/producers
54232024-12-21T07:50:35.154ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = e2e45dd6-1479-4aab-8030-3bcab95a4f4b
54242024-12-21T07:50:35.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56925 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47196 req_id = 950587a6-e3a0-44f0-8e6e-d0013e913aad response_code = 201 uri = /metrics/producers
54252024-12-21T07:50:35.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 442b0487-ac0c-46f6-abf1-9c0360039a26 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54262024-12-21T07:50:35.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 442b0487-ac0c-46f6-abf1-9c0360039a26 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54272024-12-21T07:50:35.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 442b0487-ac0c-46f6-abf1-9c0360039a26 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54282024-12-21T07:50:36.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0f47f59e-573a-403b-9bfb-e7b76bbe554d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54292024-12-21T07:50:36.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0f47f59e-573a-403b-9bfb-e7b76bbe554d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54302024-12-21T07:50:36.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0f47f59e-573a-403b-9bfb-e7b76bbe554d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54312024-12-21T07:50:37.173ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:52107
54322024-12-21T07:50:37.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52107 req_id = 62d1aa3a-5f96-405b-b375-2e11b875664d roles = RoleSet { roles: {} } uri = /metrics/producers
54332024-12-21T07:50:37.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52107 req_id = 62d1aa3a-5f96-405b-b375-2e11b875664d resource = Database result = Ok(()) uri = /metrics/producers
54342024-12-21T07:50:37.213ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 5032d219-f3bf-40f5-8e36-efba904d39be
54352024-12-21T07:50:37.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40255 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52107 req_id = 62d1aa3a-5f96-405b-b375-2e11b875664d response_code = 201 uri = /metrics/producers
54362024-12-21T07:50:37.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f9beaa77-e6d7-4ea3-aeff-2a281bf40be8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54372024-12-21T07:50:37.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f9beaa77-e6d7-4ea3-aeff-2a281bf40be8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54382024-12-21T07:50:37.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1847 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f9beaa77-e6d7-4ea3-aeff-2a281bf40be8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54392024-12-21T07:50:38.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1f221a7b-38ca-402e-b7e9-57d678528f39 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54402024-12-21T07:50:38.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1f221a7b-38ca-402e-b7e9-57d678528f39 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54412024-12-21T07:50:38.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1f221a7b-38ca-402e-b7e9-57d678528f39 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54422024-12-21T07:50:39.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1793 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 11d4e770-0bbe-4ce8-8b93-402113ff1cc7 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
54432024-12-21T07:50:39.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e6038028-ea4c-48b1-8893-71e4dfed757e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54442024-12-21T07:50:39.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e6038028-ea4c-48b1-8893-71e4dfed757e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54452024-12-21T07:50:39.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e6038028-ea4c-48b1-8893-71e4dfed757e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54462024-12-21T07:50:40.665ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
54472024-12-21T07:50:40.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
54482024-12-21T07:50:40.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54492024-12-21T07:50:40.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54502024-12-21T07:50:40.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54512024-12-21T07:50:40.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54522024-12-21T07:50:40.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54532024-12-21T07:50:40.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54542024-12-21T07:50:40.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54552024-12-21T07:50:40.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54562024-12-21T07:50:40.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54572024-12-21T07:50:40.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54582024-12-21T07:50:40.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54592024-12-21T07:50:40.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
54602024-12-21T07:50:40.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54612024-12-21T07:50:40.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54622024-12-21T07:50:40.688ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
54632024-12-21T07:50:40.688ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.678787ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
54642024-12-21T07:50:40.695ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54652024-12-21T07:50:40.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54662024-12-21T07:50:40.723ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.64788ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54672024-12-21T07:50:40.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5d184269-b7e7-464d-b9e3-02b1e0536827 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54682024-12-21T07:50:40.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5d184269-b7e7-464d-b9e3-02b1e0536827 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54692024-12-21T07:50:40.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5d184269-b7e7-464d-b9e3-02b1e0536827 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54702024-12-21T07:50:41.561ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:64425
54712024-12-21T07:50:41.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64425 req_id = fcbd6ddd-0417-431e-9993-549db52ae7cf roles = RoleSet { roles: {} } uri = /metrics/producers
54722024-12-21T07:50:41.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64425 req_id = fcbd6ddd-0417-431e-9993-549db52ae7cf resource = Database result = Ok(()) uri = /metrics/producers
54732024-12-21T07:50:41.603ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 5518d5c2-1f45-4e85-8fb9-41e1149133a1
54742024-12-21T07:50:41.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42219 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64425 req_id = fcbd6ddd-0417-431e-9993-549db52ae7cf response_code = 201 uri = /metrics/producers
54752024-12-21T07:50:41.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0d20ff7f-f0f2-4cc2-bea3-864e8d824789 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54762024-12-21T07:50:41.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0d20ff7f-f0f2-4cc2-bea3-864e8d824789 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54772024-12-21T07:50:41.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0d20ff7f-f0f2-4cc2-bea3-864e8d824789 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54782024-12-21T07:50:42.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 35718196-1b96-4e9f-8c0e-44a2c5be9277 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54792024-12-21T07:50:42.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 35718196-1b96-4e9f-8c0e-44a2c5be9277 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54802024-12-21T07:50:42.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 35718196-1b96-4e9f-8c0e-44a2c5be9277 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54812024-12-21T07:50:43.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1084458e-7d9f-4a81-a833-5351f95c7bf7 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54822024-12-21T07:50:43.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1084458e-7d9f-4a81-a833-5351f95c7bf7 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54832024-12-21T07:50:43.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1084458e-7d9f-4a81-a833-5351f95c7bf7 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54842024-12-21T07:50:44.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 27af885b-1e72-43e3-b301-0f5e4f599ea3 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54852024-12-21T07:50:44.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 27af885b-1e72-43e3-b301-0f5e4f599ea3 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54862024-12-21T07:50:44.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 27af885b-1e72-43e3-b301-0f5e4f599ea3 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54872024-12-21T07:50:45.186ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:50388
54882024-12-21T07:50:45.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50388 req_id = 218495c1-2c69-4dc4-a8b1-3fca7b0bdbf2 roles = RoleSet { roles: {} } uri = /metrics/producers
54892024-12-21T07:50:45.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50388 req_id = 218495c1-2c69-4dc4-a8b1-3fca7b0bdbf2 resource = Database result = Ok(()) uri = /metrics/producers
54902024-12-21T07:50:45.207ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 54344af8-3e4f-4625-a3a8-19b1290c40fc
54912024-12-21T07:50:45.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21358 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50388 req_id = 218495c1-2c69-4dc4-a8b1-3fca7b0bdbf2 response_code = 201 uri = /metrics/producers
54922024-12-21T07:50:45.374ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:41207
54932024-12-21T07:50:45.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41207 req_id = 60818b94-0a6d-40b9-9b1d-59379fd21134 roles = RoleSet { roles: {} } uri = /metrics/producers
54942024-12-21T07:50:45.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41207 req_id = 60818b94-0a6d-40b9-9b1d-59379fd21134 resource = Database result = Ok(()) uri = /metrics/producers
54952024-12-21T07:50:45.389ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 9c233aaf-fd1f-4081-b1ff-c3b56dd02b1b
54962024-12-21T07:50:45.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14968 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41207 req_id = 60818b94-0a6d-40b9-9b1d-59379fd21134 response_code = 201 uri = /metrics/producers
54972024-12-21T07:50:46.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c37f218f-1fa8-4ac6-ab4f-b272abdfc242 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54982024-12-21T07:50:46.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c37f218f-1fa8-4ac6-ab4f-b272abdfc242 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
54992024-12-21T07:50:46.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c37f218f-1fa8-4ac6-ab4f-b272abdfc242 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55002024-12-21T07:50:47.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 22559fd5-b77a-45f9-9090-b600e19aa366 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55012024-12-21T07:50:47.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 22559fd5-b77a-45f9-9090-b600e19aa366 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55022024-12-21T07:50:47.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 22559fd5-b77a-45f9-9090-b600e19aa366 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55032024-12-21T07:50:48.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 760d87da-947d-46e8-9748-8c1ac29dfc14 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55042024-12-21T07:50:48.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 760d87da-947d-46e8-9748-8c1ac29dfc14 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55052024-12-21T07:50:48.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 760d87da-947d-46e8-9748-8c1ac29dfc14 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55062024-12-21T07:50:48.311ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:63377
55072024-12-21T07:50:48.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63377 req_id = a7b5e3c5-1c21-4cc3-872a-4d5e5047d730 roles = RoleSet { roles: {} } uri = /metrics/producers
55082024-12-21T07:50:48.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63377 req_id = a7b5e3c5-1c21-4cc3-872a-4d5e5047d730 resource = Database result = Ok(()) uri = /metrics/producers
55092024-12-21T07:50:48.322ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55102024-12-21T07:50:48.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10704 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63377 req_id = a7b5e3c5-1c21-4cc3-872a-4d5e5047d730 response_code = 201 uri = /metrics/producers
55112024-12-21T07:50:49.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c644d0c4-7f60-4abf-9c50-6c6ee1fb98b2 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55122024-12-21T07:50:49.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c644d0c4-7f60-4abf-9c50-6c6ee1fb98b2 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55132024-12-21T07:50:49.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c644d0c4-7f60-4abf-9c50-6c6ee1fb98b2 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55142024-12-21T07:50:49.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = e1ece42c-6ca0-4e63-92c4-ba3101eb1ee2 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
55152024-12-21T07:50:49.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = e1ece42c-6ca0-4e63-92c4-ba3101eb1ee2 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
55162024-12-21T07:50:49.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = e1ece42c-6ca0-4e63-92c4-ba3101eb1ee2 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
55172024-12-21T07:50:49.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = e435994d-465a-42b7-ac19-d9eee17b1fbf roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
55182024-12-21T07:50:49.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = e435994d-465a-42b7-ac19-d9eee17b1fbf resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
55192024-12-21T07:50:49.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = e435994d-465a-42b7-ac19-d9eee17b1fbf response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
55202024-12-21T07:50:49.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1234 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 6ed9a362-00b4-4a0f-aea6-ab9d6d957497 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
55212024-12-21T07:50:50.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 85a98c1b-ef8b-4f3f-9f78-4c53535b0a0e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55222024-12-21T07:50:50.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 85a98c1b-ef8b-4f3f-9f78-4c53535b0a0e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55232024-12-21T07:50:50.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 85a98c1b-ef8b-4f3f-9f78-4c53535b0a0e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55242024-12-21T07:50:50.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
55252024-12-21T07:50:50.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55262024-12-21T07:50:50.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
55272024-12-21T07:50:50.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55282024-12-21T07:50:50.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55292024-12-21T07:50:50.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55302024-12-21T07:50:50.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55312024-12-21T07:50:50.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55322024-12-21T07:50:50.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55332024-12-21T07:50:50.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55342024-12-21T07:50:50.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55352024-12-21T07:50:50.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55362024-12-21T07:50:50.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55372024-12-21T07:50:50.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
55382024-12-21T07:50:50.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55392024-12-21T07:50:50.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55402024-12-21T07:50:50.692ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
55412024-12-21T07:50:50.692ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.053544ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
55422024-12-21T07:50:50.703ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55432024-12-21T07:50:50.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55442024-12-21T07:50:50.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.739315ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55452024-12-21T07:50:51.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 21c8fddd-4204-4207-8a56-007ac9e921af roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55462024-12-21T07:50:51.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 21c8fddd-4204-4207-8a56-007ac9e921af resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55472024-12-21T07:50:51.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 21c8fddd-4204-4207-8a56-007ac9e921af response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55482024-12-21T07:50:52.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c9fe4360-577e-4d8c-b800-93e89a6d6fb9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55492024-12-21T07:50:52.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c9fe4360-577e-4d8c-b800-93e89a6d6fb9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55502024-12-21T07:50:52.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c9fe4360-577e-4d8c-b800-93e89a6d6fb9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55512024-12-21T07:50:53.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1eb83b15-82c1-4a6c-ba46-435f99b3cd2b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55522024-12-21T07:50:53.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1eb83b15-82c1-4a6c-ba46-435f99b3cd2b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55532024-12-21T07:50:53.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1867 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1eb83b15-82c1-4a6c-ba46-435f99b3cd2b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55542024-12-21T07:50:54.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3060cc50-c425-4975-8437-7853ed4c7c24 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55552024-12-21T07:50:54.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3060cc50-c425-4975-8437-7853ed4c7c24 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55562024-12-21T07:50:54.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3060cc50-c425-4975-8437-7853ed4c7c24 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55572024-12-21T07:50:55.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9e870e8a-57b2-41d1-9f2a-9c09ad37da54 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55582024-12-21T07:50:55.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9e870e8a-57b2-41d1-9f2a-9c09ad37da54 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55592024-12-21T07:50:55.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9e870e8a-57b2-41d1-9f2a-9c09ad37da54 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55602024-12-21T07:50:56.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0585089d-f9f3-498c-9f07-092029fb0011 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55612024-12-21T07:50:56.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0585089d-f9f3-498c-9f07-092029fb0011 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55622024-12-21T07:50:56.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0585089d-f9f3-498c-9f07-092029fb0011 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55632024-12-21T07:50:57.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 52263781-3611-4c31-a8f4-d298f9662586 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55642024-12-21T07:50:57.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 52263781-3611-4c31-a8f4-d298f9662586 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55652024-12-21T07:50:57.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 52263781-3611-4c31-a8f4-d298f9662586 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55662024-12-21T07:50:58.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5ee419b7-206f-4bbc-a133-43f7ff0bba4e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55672024-12-21T07:50:58.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5ee419b7-206f-4bbc-a133-43f7ff0bba4e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55682024-12-21T07:50:58.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1786 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5ee419b7-206f-4bbc-a133-43f7ff0bba4e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55692024-12-21T07:50:59.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 66bd0422-8055-4554-a5ad-c0505104e5b8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55702024-12-21T07:50:59.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 66bd0422-8055-4554-a5ad-c0505104e5b8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55712024-12-21T07:50:59.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 66bd0422-8055-4554-a5ad-c0505104e5b8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55722024-12-21T07:50:59.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1619 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = dd88ab95-0527-4088-b253-3c864c61ba1a response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
55732024-12-21T07:51:00.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 53b228fe-20a7-4bbf-8a6f-778c3e47df27 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55742024-12-21T07:51:00.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 53b228fe-20a7-4bbf-8a6f-778c3e47df27 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55752024-12-21T07:51:00.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 53b228fe-20a7-4bbf-8a6f-778c3e47df27 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
55762024-12-21T07:51:00.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = bbccbdd1-da66-40f5-839d-269fdf5f1a13 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
55772024-12-21T07:51:00.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = bbccbdd1-da66-40f5-839d-269fdf5f1a13 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
55782024-12-21T07:51:00.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = bbccbdd1-da66-40f5-839d-269fdf5f1a13 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
55792024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
55802024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
55812024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
55822024-12-21T07:51:00.666ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
55832024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
55842024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
55852024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
55862024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
55872024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
55882024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55892024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
55902024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
55912024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55922024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55932024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
55942024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55952024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
55962024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55972024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
55982024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
55992024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
56002024-12-21T07:51:00.666ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
56012024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56022024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
56032024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
56042024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56052024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
56062024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
56072024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56082024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
56092024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56102024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
56112024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56122024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
56132024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
56142024-12-21T07:51:00.666ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:41:00.666784845 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
56152024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
56162024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
56172024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
56182024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
56192024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56202024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
56212024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
56222024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
56232024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
56242024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
56252024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
56262024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56272024-12-21T07:51:00.666ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b
56282024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56292024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.99\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b"}
56302024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
56312024-12-21T07:51:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
56322024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
56332024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
56342024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56352024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
56362024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
56372024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
56382024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
56392024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
56402024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56412024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56422024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
56432024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56442024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56452024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56462024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
56472024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56482024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
56492024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56502024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56512024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56522024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56532024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56542024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56552024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
56562024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
56572024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56582024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56592024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56602024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56612024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56622024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56632024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
56642024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56652024-12-21T07:51:00.667ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dd95bbd-e009-486c-8c96-451a6e195a49.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1394, tv_nsec: 366891111 } })
56662024-12-21T07:51:00.667ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bfae345-1659-4377-bca9-c55abec2aeb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7c426166-4f75-4a87-b9ac-c0d590aea49b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1394, tv_nsec: 366931532 } })
56672024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
56682024-12-21T07:51:00.667ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.21866ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
56692024-12-21T07:51:00.668ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
56702024-12-21T07:51:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.278302ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
56712024-12-21T07:51:00.669ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56722024-12-21T07:51:00.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56732024-12-21T07:51:00.670ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.535649ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56742024-12-21T07:51:00.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
56752024-12-21T07:51:00.671ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
56762024-12-21T07:51:00.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
56772024-12-21T07:51:00.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56782024-12-21T07:51:00.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56792024-12-21T07:51:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56802024-12-21T07:51:00.673ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.417603ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
56812024-12-21T07:51:00.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56822024-12-21T07:51:00.676ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56832024-12-21T07:51:00.676ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56842024-12-21T07:51:00.678ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:41:00.666784845 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
56852024-12-21T07:51:00.678ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.609803ms iteration = 9 status = {"expiration":"2024-12-21T07:41:00.666784845Z","pruned":[]}
56862024-12-21T07:51:00.679ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56872024-12-21T07:51:00.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56882024-12-21T07:51:00.679ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
56892024-12-21T07:51:00.679ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56902024-12-21T07:51:00.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
56912024-12-21T07:51:00.679ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56922024-12-21T07:51:00.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56932024-12-21T07:51:00.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56942024-12-21T07:51:00.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56952024-12-21T07:51:00.681ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56962024-12-21T07:51:00.681ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56972024-12-21T07:51:00.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56982024-12-21T07:51:00.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56992024-12-21T07:51:00.684ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57002024-12-21T07:51:00.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57012024-12-21T07:51:00.685ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1394, tv_nsec: 384614496 } })
57022024-12-21T07:51:00.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57032024-12-21T07:51:00.685ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
57042024-12-21T07:51:00.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57052024-12-21T07:51:00.686ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1394, tv_nsec: 385697214 } })
57062024-12-21T07:51:00.686ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
57072024-12-21T07:51:00.687ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57082024-12-21T07:51:00.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57092024-12-21T07:51:00.688ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57102024-12-21T07:51:00.688ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57112024-12-21T07:51:00.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57122024-12-21T07:51:00.689ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1394, tv_nsec: 389379895 } })
57132024-12-21T07:51:00.690ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
57142024-12-21T07:51:00.691ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57152024-12-21T07:51:00.691ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57162024-12-21T07:51:00.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57172024-12-21T07:51:00.697ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57182024-12-21T07:51:00.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57192024-12-21T07:51:00.699ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57202024-12-21T07:51:00.702ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57212024-12-21T07:51:00.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
57222024-12-21T07:51:00.702ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57232024-12-21T07:51:00.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57242024-12-21T07:51:00.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57252024-12-21T07:51:00.704ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57262024-12-21T07:51:00.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57272024-12-21T07:51:00.706ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57282024-12-21T07:51:00.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57292024-12-21T07:51:00.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57302024-12-21T07:51:00.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57312024-12-21T07:51:00.710ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 44.300818ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
57322024-12-21T07:51:00.711ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57332024-12-21T07:51:00.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57342024-12-21T07:51:00.713ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57352024-12-21T07:51:00.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57362024-12-21T07:51:00.715ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
57372024-12-21T07:51:00.715ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
57382024-12-21T07:51:00.715ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 48.551858ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
57392024-12-21T07:51:00.717ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57402024-12-21T07:51:00.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57412024-12-21T07:51:00.718ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57422024-12-21T07:51:00.718ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
57432024-12-21T07:51:00.718ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57442024-12-21T07:51:00.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57452024-12-21T07:51:00.720ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
57462024-12-21T07:51:00.720ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
57472024-12-21T07:51:00.720ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 53.645483ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
57482024-12-21T07:51:00.721ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57492024-12-21T07:51:00.721ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
57502024-12-21T07:51:00.721ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57512024-12-21T07:51:00.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57522024-12-21T07:51:00.721ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57532024-12-21T07:51:00.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57542024-12-21T07:51:00.724ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.825682ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
57552024-12-21T07:51:00.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57562024-12-21T07:51:00.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57572024-12-21T07:51:00.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57582024-12-21T07:51:00.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57592024-12-21T07:51:00.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57602024-12-21T07:51:00.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57612024-12-21T07:51:00.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
57622024-12-21T07:51:00.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
57632024-12-21T07:51:00.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57642024-12-21T07:51:00.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57652024-12-21T07:51:00.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57662024-12-21T07:51:00.734ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57672024-12-21T07:51:00.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57682024-12-21T07:51:00.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
57692024-12-21T07:51:00.752ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57702024-12-21T07:51:00.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57712024-12-21T07:51:00.756ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.348277ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57722024-12-21T07:51:00.756ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57732024-12-21T07:51:00.760ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
57742024-12-21T07:51:00.760ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57752024-12-21T07:51:00.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57762024-12-21T07:51:00.761ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.040051ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57772024-12-21T07:51:00.762ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
57782024-12-21T07:51:00.762ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.173781ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
57792024-12-21T07:51:00.765ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 99.17796ms iteration = 20 status = {"physical_disks_added":0}
57802024-12-21T07:51:00.766ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57812024-12-21T07:51:00.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
57822024-12-21T07:51:00.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57832024-12-21T07:51:00.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
57842024-12-21T07:51:00.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57852024-12-21T07:51:00.768ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57862024-12-21T07:51:00.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57872024-12-21T07:51:00.768ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
57882024-12-21T07:51:00.768ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 102.255542ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
57892024-12-21T07:51:00.770ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57902024-12-21T07:51:00.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57912024-12-21T07:51:00.772ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
57922024-12-21T07:51:00.772ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 105.587126ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
57932024-12-21T07:51:00.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57942024-12-21T07:51:00.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
57952024-12-21T07:51:00.775ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57962024-12-21T07:51:00.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57972024-12-21T07:51:00.777ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 110.196973ms iteration = 17 status = 0
57982024-12-21T07:51:00.777ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
57992024-12-21T07:51:00.777ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
58002024-12-21T07:51:00.777ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
58012024-12-21T07:51:00.777ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58022024-12-21T07:51:00.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58032024-12-21T07:51:00.779ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 112.549563ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58042024-12-21T07:51:00.780ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
58052024-12-21T07:51:00.780ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
58062024-12-21T07:51:00.780ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
58072024-12-21T07:51:00.780ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58082024-12-21T07:51:00.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58092024-12-21T07:51:00.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58102024-12-21T07:51:00.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58112024-12-21T07:51:00.785ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58122024-12-21T07:51:00.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58132024-12-21T07:51:00.799ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
58142024-12-21T07:51:00.799ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
58152024-12-21T07:51:00.806ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:42:50.264108Z, time_modified: 2024-12-21T07:42:50.264108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }) }
58162024-12-21T07:51:00.806ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 139.567462ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]}},"default_endpoint":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
58172024-12-21T07:51:00.813ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58182024-12-21T07:51:00.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58192024-12-21T07:51:00.821ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 154.44853ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
58202024-12-21T07:51:00.827ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58212024-12-21T07:51:00.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58222024-12-21T07:51:00.830ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58232024-12-21T07:51:00.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58242024-12-21T07:51:00.833ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58252024-12-21T07:51:00.833ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58262024-12-21T07:51:00.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58272024-12-21T07:51:00.835ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58282024-12-21T07:51:00.835ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
58292024-12-21T07:51:00.835ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 0 version = 2
58302024-12-21T07:51:00.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58312024-12-21T07:51:00.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58322024-12-21T07:51:00.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58332024-12-21T07:51:00.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58342024-12-21T07:51:00.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58352024-12-21T07:51:00.837ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58362024-12-21T07:51:00.837ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58372024-12-21T07:51:00.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58382024-12-21T07:51:00.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58392024-12-21T07:51:00.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58402024-12-21T07:51:00.842ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58412024-12-21T07:51:00.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58422024-12-21T07:51:00.844ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 1 version = 2
58432024-12-21T07:51:00.844ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
58442024-12-21T07:51:00.844ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:43:41.075205 UTC dns_group = external generation = 2
58452024-12-21T07:51:00.844ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 177.696117ms iteration = 10 status = {"generation":2}
58462024-12-21T07:51:00.853ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
58472024-12-21T07:51:00.853ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58482024-12-21T07:51:00.853ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "da41283c-a21b-430e-873c-8b32a53ddcbb", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:00 GMT"} })
58492024-12-21T07:51:00.853ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58502024-12-21T07:51:00.856ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
58512024-12-21T07:51:00.866ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
58522024-12-21T07:51:00.866ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58532024-12-21T07:51:00.866ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1dc72626-43e7-40bd-8aa7-56d7a61582df", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:00 GMT"} })
58542024-12-21T07:51:00.866ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58552024-12-21T07:51:00.869ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58562024-12-21T07:51:00.871ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
58572024-12-21T07:51:00.871ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58582024-12-21T07:51:00.871ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0fd9c16-cc61-41ed-a4d5-fe0235d7a1e2", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:00 GMT"} })
58592024-12-21T07:51:00.871ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58602024-12-21T07:51:00.873ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58612024-12-21T07:51:00.876ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
58622024-12-21T07:51:00.876ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
58632024-12-21T07:51:00.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58642024-12-21T07:51:00.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58652024-12-21T07:51:00.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58662024-12-21T07:51:00.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58672024-12-21T07:51:00.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58682024-12-21T07:51:00.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58692024-12-21T07:51:00.909ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
58702024-12-21T07:51:00.909ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 242.382173ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
58712024-12-21T07:51:01.004ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
58722024-12-21T07:51:01.032ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
58732024-12-21T07:51:01.032ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "dc824a65-a966-4818-a365-ecbc8c6c4fe2", "date": "Sat, 21 Dec 2024 07:51:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
58742024-12-21T07:51:01.032ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
58752024-12-21T07:51:01.034ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7d3f3b00-3750-42ec-9572-3e3cb179deb8", "date": "Sat, 21 Dec 2024 07:51:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
58762024-12-21T07:51:01.034ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
58772024-12-21T07:51:01.036ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
58782024-12-21T07:51:01.036ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 369.808213ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
58792024-12-21T07:51:01.086ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
58802024-12-21T07:51:01.086ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "05f369bd-fcaa-4e9e-b7c6-f1d9590d755e", "content-length": "1", "date": "Sat, 21 Dec 2024 07:51:00 GMT"} })
58812024-12-21T07:51:01.088ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58822024-12-21T07:51:01.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58832024-12-21T07:51:01.149ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
58842024-12-21T07:51:01.149ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58852024-12-21T07:51:01.149ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecb01139-676f-4c63-a962-96f5870e5510", "content-length": "372", "date": "Sat, 21 Dec 2024 07:51:01 GMT"} })
58862024-12-21T07:51:01.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58872024-12-21T07:51:01.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58882024-12-21T07:51:01.152ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
58892024-12-21T07:51:01.152ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
58902024-12-21T07:51:01.152ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:43:39.444085 UTC dns_group = internal generation = 1
58912024-12-21T07:51:01.152ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 485.318465ms iteration = 10 status = {"generation":1}
58922024-12-21T07:51:01.152ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 485.317175ms iteration = 17 status = null
58932024-12-21T07:51:01.164ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
58942024-12-21T07:51:01.164ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
58952024-12-21T07:51:01.165ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ceece966-6850-430f-ba76-8b11a4a32e53", "date": "Sat, 21 Dec 2024 07:51:01 GMT"} })
58962024-12-21T07:51:01.165ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58972024-12-21T07:51:01.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58982024-12-21T07:51:01.167ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58992024-12-21T07:51:01.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59002024-12-21T07:51:01.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59012024-12-21T07:51:01.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59022024-12-21T07:51:01.172ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
59032024-12-21T07:51:01.172ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59042024-12-21T07:51:01.173ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0f8f95de-b0d1-4055-99f7-5497f204aa02", "date": "Sat, 21 Dec 2024 07:51:01 GMT"} })
59052024-12-21T07:51:01.174ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 507.982993ms iteration = 18 status = {}
59062024-12-21T07:51:01.177ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
59072024-12-21T07:51:01.178ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4fb8ae0b-f7ea-4ab4-9545-cca01cc945c0", "date": "Sat, 21 Dec 2024 07:51:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
59082024-12-21T07:51:01.178ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
59092024-12-21T07:51:01.182ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ebb89929-d476-4d2a-a291-68b959c9b23a", "date": "Sat, 21 Dec 2024 07:51:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
59102024-12-21T07:51:01.182ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
59112024-12-21T07:51:01.182ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 515.598288ms iteration = 17 status = {}
59122024-12-21T07:51:01.184ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e167e30d-0b9b-468f-a8eb-a22cd3084e13", "date": "Sat, 21 Dec 2024 07:51:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
59132024-12-21T07:51:01.184ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
59142024-12-21T07:51:01.186ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
59152024-12-21T07:51:01.186ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 520.122254ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
59162024-12-21T07:51:01.200ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59172024-12-21T07:51:01.200ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bf7b3c5-552b-4f7c-99c6-189239fcc7c4", "content-length": "691", "date": "Sat, 21 Dec 2024 07:51:01 GMT"} })
59182024-12-21T07:51:01.200ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
59192024-12-21T07:51:01.200ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
59202024-12-21T07:51:01.200ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
59212024-12-21T07:51:01.202ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 535.428049ms iteration = 17 status = {}
59222024-12-21T07:51:01.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59232024-12-21T07:51:01.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59242024-12-21T07:51:01.231ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
59252024-12-21T07:51:01.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59262024-12-21T07:51:01.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59272024-12-21T07:51:01.240ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
59282024-12-21T07:51:01.241ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "da91bb11-a603-41c0-b5ae-beb4c06cc002", "content-length": "134", "date": "Sat, 21 Dec 2024 07:51:00 GMT"} })
59292024-12-21T07:51:01.241ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
59302024-12-21T07:51:01.241ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
59312024-12-21T07:51:01.241ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
59322024-12-21T07:51:01.241ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59332024-12-21T07:51:01.241ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59342024-12-21T07:51:01.241ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59352024-12-21T07:51:01.241ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59362024-12-21T07:51:01.241ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59372024-12-21T07:51:01.241ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59382024-12-21T07:51:01.241ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59392024-12-21T07:51:01.241ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
59402024-12-21T07:51:01.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59412024-12-21T07:51:01.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59422024-12-21T07:51:01.244ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
59432024-12-21T07:51:01.244ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e96f953-6244-4874-bd00-4da72de3f3e1", "content-length": "2", "date": "Sat, 21 Dec 2024 07:51:00 GMT"} })
59442024-12-21T07:51:01.244ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
59452024-12-21T07:51:01.244ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee68236e-caab-4b2e-9704-533d3d476f95", "content-length": "52", "date": "Sat, 21 Dec 2024 07:51:00 GMT"} })
59462024-12-21T07:51:01.244ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
59472024-12-21T07:51:01.244ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
59482024-12-21T07:51:01.339ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9443a856-e52e-4c06-818d-cc5a49f45740", "date": "Sat, 21 Dec 2024 07:51:01 GMT"} })
59492024-12-21T07:51:01.339ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
59502024-12-21T07:51:01.339ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
59512024-12-21T07:51:01.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3d242b0a-e49e-4348-9d50-542a67507a39 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59522024-12-21T07:51:01.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3d242b0a-e49e-4348-9d50-542a67507a39 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59532024-12-21T07:51:01.340ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "97083fcb-da46-476f-b402-aa61b419b409", "content-length": "682", "date": "Sat, 21 Dec 2024 07:51:01 GMT"} })
59542024-12-21T07:51:01.340ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59552024-12-21T07:51:01.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59562024-12-21T07:51:01.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3d242b0a-e49e-4348-9d50-542a67507a39 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59572024-12-21T07:51:01.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59582024-12-21T07:51:01.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59592024-12-21T07:51:01.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59602024-12-21T07:51:01.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59612024-12-21T07:51:01.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59622024-12-21T07:51:01.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59632024-12-21T07:51:01.356ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 689.838498ms iteration = 17 status = {}
59642024-12-21T07:51:02.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0e675884-8041-44b4-843b-ea8aaded8b74 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59652024-12-21T07:51:02.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0e675884-8041-44b4-843b-ea8aaded8b74 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59662024-12-21T07:51:02.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0e675884-8041-44b4-843b-ea8aaded8b74 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59672024-12-21T07:51:03.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3372b68b-4ba7-4509-a48b-143e8467c5ff roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59682024-12-21T07:51:03.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3372b68b-4ba7-4509-a48b-143e8467c5ff resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59692024-12-21T07:51:03.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2887 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3372b68b-4ba7-4509-a48b-143e8467c5ff response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59702024-12-21T07:51:04.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cbfc1fa8-ab31-458a-bfc8-8dcab43bfdef roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59712024-12-21T07:51:04.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cbfc1fa8-ab31-458a-bfc8-8dcab43bfdef resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59722024-12-21T07:51:04.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2625 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cbfc1fa8-ab31-458a-bfc8-8dcab43bfdef response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59732024-12-21T07:51:05.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e34a26e0-a1fa-48b6-aaaf-9d99596f1ba9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59742024-12-21T07:51:05.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e34a26e0-a1fa-48b6-aaaf-9d99596f1ba9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59752024-12-21T07:51:05.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2541 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e34a26e0-a1fa-48b6-aaaf-9d99596f1ba9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59762024-12-21T07:51:06.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7eb54c5a-2832-48c0-97c0-7de722135892 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59772024-12-21T07:51:06.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7eb54c5a-2832-48c0-97c0-7de722135892 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59782024-12-21T07:51:06.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7eb54c5a-2832-48c0-97c0-7de722135892 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59792024-12-21T07:51:07.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5a43307d-e625-4953-a68b-678fc68c0d1d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59802024-12-21T07:51:07.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5a43307d-e625-4953-a68b-678fc68c0d1d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59812024-12-21T07:51:07.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5a43307d-e625-4953-a68b-678fc68c0d1d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59822024-12-21T07:51:08.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bd0c8cb3-df73-4173-8424-c4d39b95a6be roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59832024-12-21T07:51:08.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bd0c8cb3-df73-4173-8424-c4d39b95a6be resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59842024-12-21T07:51:08.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bd0c8cb3-df73-4173-8424-c4d39b95a6be response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59852024-12-21T07:51:09.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = feb04852-69b6-4908-98d2-24e12dca5193 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59862024-12-21T07:51:09.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = feb04852-69b6-4908-98d2-24e12dca5193 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59872024-12-21T07:51:09.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = feb04852-69b6-4908-98d2-24e12dca5193 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59882024-12-21T07:51:09.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 4042b77a-2be2-48aa-ae6d-cf1bed940303 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
59892024-12-21T07:51:10.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 010f84c8-63e7-4267-8c3c-ecd457534de9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59902024-12-21T07:51:10.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 010f84c8-63e7-4267-8c3c-ecd457534de9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59912024-12-21T07:51:10.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 010f84c8-63e7-4267-8c3c-ecd457534de9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
59922024-12-21T07:51:10.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
59932024-12-21T07:51:10.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
59942024-12-21T07:51:10.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59952024-12-21T07:51:10.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59962024-12-21T07:51:10.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59972024-12-21T07:51:10.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59982024-12-21T07:51:10.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59992024-12-21T07:51:10.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60002024-12-21T07:51:10.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60012024-12-21T07:51:10.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60022024-12-21T07:51:10.700ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60032024-12-21T07:51:10.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60042024-12-21T07:51:10.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60052024-12-21T07:51:10.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60062024-12-21T07:51:10.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.852602ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60072024-12-21T07:51:10.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60082024-12-21T07:51:10.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
60092024-12-21T07:51:10.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60102024-12-21T07:51:10.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60112024-12-21T07:51:10.744ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
60122024-12-21T07:51:10.745ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.753241ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
60132024-12-21T07:51:11.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 466d7074-989a-437a-88b7-89fa8fba103c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60142024-12-21T07:51:11.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 466d7074-989a-437a-88b7-89fa8fba103c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60152024-12-21T07:51:11.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 466d7074-989a-437a-88b7-89fa8fba103c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60162024-12-21T07:51:12.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0024293c-4abe-479a-b4f9-e40e7df6adca roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60172024-12-21T07:51:12.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0024293c-4abe-479a-b4f9-e40e7df6adca resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60182024-12-21T07:51:12.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0024293c-4abe-479a-b4f9-e40e7df6adca response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60192024-12-21T07:51:12.744ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
60202024-12-21T07:51:12.744ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
60212024-12-21T07:51:12.775ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
60222024-12-21T07:51:12.775ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:53758
60232024-12-21T07:51:12.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:53758 req_id = 79bb430a-07ef-4173-a9f5-a5d58ea3fce0 roles = RoleSet { roles: {} } uri = /metrics/producers
60242024-12-21T07:51:12.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:53758 req_id = 79bb430a-07ef-4173-a9f5-a5d58ea3fce0 resource = Database result = Ok(()) uri = /metrics/producers
60252024-12-21T07:51:12.813ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = a920b126-b55b-45c8-9984-5279bf662759
60262024-12-21T07:51:12.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37940 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:53758 req_id = 79bb430a-07ef-4173-a9f5-a5d58ea3fce0 response_code = 201 uri = /metrics/producers
60272024-12-21T07:51:12.813ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "79bb430a-07ef-4173-a9f5-a5d58ea3fce0", "content-length": "41", "date": "Sat, 21 Dec 2024 07:51:12 GMT"} })
60282024-12-21T07:51:12.815ZDEBGnexus (producer-registration-task): registered with nexus successfully
60292024-12-21T07:51:12.815ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
60302024-12-21T07:51:13.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 15a736b6-c005-4d16-8fb7-0f446b4824fc roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60312024-12-21T07:51:13.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 15a736b6-c005-4d16-8fb7-0f446b4824fc resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60322024-12-21T07:51:13.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 15a736b6-c005-4d16-8fb7-0f446b4824fc response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60332024-12-21T07:51:14.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 756378a7-e431-4d4b-b56f-c7a8bcdf6c35 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60342024-12-21T07:51:14.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 756378a7-e431-4d4b-b56f-c7a8bcdf6c35 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60352024-12-21T07:51:14.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1625 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 756378a7-e431-4d4b-b56f-c7a8bcdf6c35 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60362024-12-21T07:51:15.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 83c5bf0b-10b5-4c9e-a1d3-3603b4dabe60 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60372024-12-21T07:51:15.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 83c5bf0b-10b5-4c9e-a1d3-3603b4dabe60 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60382024-12-21T07:51:15.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 83c5bf0b-10b5-4c9e-a1d3-3603b4dabe60 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60392024-12-21T07:51:16.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f53342c6-44f2-4a03-9187-30681698146d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60402024-12-21T07:51:16.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f53342c6-44f2-4a03-9187-30681698146d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60412024-12-21T07:51:16.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f53342c6-44f2-4a03-9187-30681698146d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60422024-12-21T07:51:17.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cd9bd690-64b0-4cdc-8a90-ae9a85e01e66 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60432024-12-21T07:51:17.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cd9bd690-64b0-4cdc-8a90-ae9a85e01e66 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60442024-12-21T07:51:17.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cd9bd690-64b0-4cdc-8a90-ae9a85e01e66 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60452024-12-21T07:51:18.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fb084808-08f6-4f8d-a51d-d7e0aa1661ab roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60462024-12-21T07:51:18.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fb084808-08f6-4f8d-a51d-d7e0aa1661ab resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60472024-12-21T07:51:18.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2004 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fb084808-08f6-4f8d-a51d-d7e0aa1661ab response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60482024-12-21T07:51:19.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c4240fc3-4a1e-4f8e-b6d0-2ea967845092 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60492024-12-21T07:51:19.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c4240fc3-4a1e-4f8e-b6d0-2ea967845092 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60502024-12-21T07:51:19.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c4240fc3-4a1e-4f8e-b6d0-2ea967845092 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60512024-12-21T07:51:19.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 6a5cfb36-3b35-4eb8-aecd-541507bc1431 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
60522024-12-21T07:51:19.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 6a5cfb36-3b35-4eb8-aecd-541507bc1431 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
60532024-12-21T07:51:19.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 6a5cfb36-3b35-4eb8-aecd-541507bc1431 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
60542024-12-21T07:51:19.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 874150a7-8987-4b40-ac02-aa0dc988368b roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
60552024-12-21T07:51:19.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 874150a7-8987-4b40-ac02-aa0dc988368b resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
60562024-12-21T07:51:19.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 874150a7-8987-4b40-ac02-aa0dc988368b response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
60572024-12-21T07:51:19.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1307 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = dddb5346-4ebc-450d-8980-16c5928f471c response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
60582024-12-21T07:51:20.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
60592024-12-21T07:51:20.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
60602024-12-21T07:51:20.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60612024-12-21T07:51:20.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60622024-12-21T07:51:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60632024-12-21T07:51:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60642024-12-21T07:51:20.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60652024-12-21T07:51:20.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60662024-12-21T07:51:20.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60672024-12-21T07:51:20.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60682024-12-21T07:51:20.700ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60692024-12-21T07:51:20.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60702024-12-21T07:51:20.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60712024-12-21T07:51:20.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60722024-12-21T07:51:20.702ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.805386ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60732024-12-21T07:51:20.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60742024-12-21T07:51:20.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
60752024-12-21T07:51:20.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60762024-12-21T07:51:20.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60772024-12-21T07:51:20.744ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
60782024-12-21T07:51:20.744ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.311616ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
60792024-12-21T07:51:20.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 94a2ec80-93f7-4667-924b-e0688b25cbe6 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60802024-12-21T07:51:20.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 94a2ec80-93f7-4667-924b-e0688b25cbe6 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60812024-12-21T07:51:20.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 94a2ec80-93f7-4667-924b-e0688b25cbe6 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60822024-12-21T07:51:21.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 24ba0a40-90cb-4b1a-b951-9be03a9b1a73 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60832024-12-21T07:51:21.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 24ba0a40-90cb-4b1a-b951-9be03a9b1a73 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60842024-12-21T07:51:21.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1700 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 24ba0a40-90cb-4b1a-b951-9be03a9b1a73 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60852024-12-21T07:51:22.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 34f053b2-e18c-4b35-ab5c-189273d6ce62 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60862024-12-21T07:51:22.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 34f053b2-e18c-4b35-ab5c-189273d6ce62 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60872024-12-21T07:51:22.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 34f053b2-e18c-4b35-ab5c-189273d6ce62 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60882024-12-21T07:51:23.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 76f57b02-efd5-41e1-825e-028dc695a1e4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60892024-12-21T07:51:23.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 76f57b02-efd5-41e1-825e-028dc695a1e4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60902024-12-21T07:51:23.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 76f57b02-efd5-41e1-825e-028dc695a1e4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60912024-12-21T07:51:24.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c3f05610-3245-4279-a999-a4348c93671d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60922024-12-21T07:51:24.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c3f05610-3245-4279-a999-a4348c93671d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60932024-12-21T07:51:24.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c3f05610-3245-4279-a999-a4348c93671d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60942024-12-21T07:51:25.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 079dad7c-7b8b-4f03-ae80-1581a72c9d36 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60952024-12-21T07:51:25.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 079dad7c-7b8b-4f03-ae80-1581a72c9d36 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60962024-12-21T07:51:25.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 079dad7c-7b8b-4f03-ae80-1581a72c9d36 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60972024-12-21T07:51:26.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b1bccfe3-1e9a-4221-a26f-01b89cf09300 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60982024-12-21T07:51:26.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b1bccfe3-1e9a-4221-a26f-01b89cf09300 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
60992024-12-21T07:51:26.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b1bccfe3-1e9a-4221-a26f-01b89cf09300 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
61002024-12-21T07:51:27.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 07bcc306-4f2b-473a-834d-210c77ede40d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
61012024-12-21T07:51:27.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 07bcc306-4f2b-473a-834d-210c77ede40d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
61022024-12-21T07:51:27.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 07bcc306-4f2b-473a-834d-210c77ede40d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
61032024-12-21T07:51:28.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ff09cdad-8e06-4728-b87f-8a56c16f3325 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
61042024-12-21T07:51:28.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ff09cdad-8e06-4728-b87f-8a56c16f3325 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
61052024-12-21T07:51:28.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ff09cdad-8e06-4728-b87f-8a56c16f3325 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
61062024-12-21T07:51:29.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1372 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 6cc2a460-6077-4845-85d8-b9a50de65639 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
61072024-12-21T07:51:29.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a3b0501c-1d66-4f40-a14a-0ddc0cd4be98 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
61082024-12-21T07:51:29.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a3b0501c-1d66-4f40-a14a-0ddc0cd4be98 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
61092024-12-21T07:51:29.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a3b0501c-1d66-4f40-a14a-0ddc0cd4be98 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
61102024-12-21T07:51:30.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 176dec31-482a-4dec-955f-41be18bfc80b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
61112024-12-21T07:51:30.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 176dec31-482a-4dec-955f-41be18bfc80b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
61122024-12-21T07:51:30.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 176dec31-482a-4dec-955f-41be18bfc80b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
61132024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
61142024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
61152024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
61162024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61172024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
61182024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61192024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
61202024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61212024-12-21T07:51:30.666ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
61222024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61232024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
61242024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61252024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
61262024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
61272024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61282024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
61292024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61302024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
61312024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
61322024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61332024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
61342024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61352024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61362024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
61372024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61382024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
61392024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
61402024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
61412024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61422024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
61432024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61442024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
61452024-12-21T07:51:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61462024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
61472024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61482024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
61492024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61502024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61512024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61522024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61532024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61542024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61552024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61562024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61572024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
61582024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61592024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61602024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61612024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61622024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61632024-12-21T07:51:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61642024-12-21T07:51:30.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.068841ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
61652024-12-21T07:51:30.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61662024-12-21T07:51:30.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61672024-12-21T07:51:30.671ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.355303ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
61682024-12-21T07:51:30.671ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61692024-12-21T07:51:30.671ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61702024-12-21T07:51:30.671ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
61712024-12-21T07:51:30.671ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61722024-12-21T07:51:30.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61732024-12-21T07:51:30.672ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 372333536 } })
61742024-12-21T07:51:30.673ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
61752024-12-21T07:51:30.673ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61762024-12-21T07:51:30.673ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61772024-12-21T07:51:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61782024-12-21T07:51:30.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61792024-12-21T07:51:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61802024-12-21T07:51:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61812024-12-21T07:51:30.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61822024-12-21T07:51:30.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61832024-12-21T07:51:30.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61842024-12-21T07:51:30.675ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61852024-12-21T07:51:30.676ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61862024-12-21T07:51:30.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61872024-12-21T07:51:30.677ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 376569156 } })
61882024-12-21T07:51:30.677ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61892024-12-21T07:51:30.677ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
61902024-12-21T07:51:30.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61912024-12-21T07:51:30.677ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61922024-12-21T07:51:30.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61932024-12-21T07:51:30.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
61942024-12-21T07:51:30.679ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61952024-12-21T07:51:30.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61962024-12-21T07:51:30.680ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61972024-12-21T07:51:30.681ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61982024-12-21T07:51:30.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61992024-12-21T07:51:30.682ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62002024-12-21T07:51:30.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62012024-12-21T07:51:30.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62022024-12-21T07:51:30.682ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1424, tv_nsec: 382156399 } })
62032024-12-21T07:51:30.683ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
62042024-12-21T07:51:30.683ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62052024-12-21T07:51:30.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62062024-12-21T07:51:30.706ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 39.549229ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
62072024-12-21T07:51:30.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62082024-12-21T07:51:30.713ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62092024-12-21T07:51:30.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62102024-12-21T07:51:30.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62112024-12-21T07:51:30.715ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62122024-12-21T07:51:30.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62132024-12-21T07:51:30.718ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62142024-12-21T07:51:30.718ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62152024-12-21T07:51:30.718ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62162024-12-21T07:51:30.718ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62172024-12-21T07:51:30.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62182024-12-21T07:51:30.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62192024-12-21T07:51:30.718ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
62202024-12-21T07:51:30.718ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 51.631729ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
62212024-12-21T07:51:30.719ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62222024-12-21T07:51:30.719ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62232024-12-21T07:51:30.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62242024-12-21T07:51:30.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62252024-12-21T07:51:30.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.756361ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62262024-12-21T07:51:30.731ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62272024-12-21T07:51:30.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62282024-12-21T07:51:30.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62292024-12-21T07:51:30.734ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62302024-12-21T07:51:30.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62312024-12-21T07:51:30.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
62322024-12-21T07:51:30.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62332024-12-21T07:51:30.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62342024-12-21T07:51:30.740ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
62352024-12-21T07:51:30.740ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62362024-12-21T07:51:30.740ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "781a8e6b-f514-472e-87a6-d9e4f257b4a7", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:29 GMT"} })
62372024-12-21T07:51:30.740ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62382024-12-21T07:51:30.742ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62392024-12-21T07:51:30.753ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62402024-12-21T07:51:30.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62412024-12-21T07:51:30.755ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62422024-12-21T07:51:30.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62432024-12-21T07:51:30.756ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
62442024-12-21T07:51:30.756ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.360297ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
62452024-12-21T07:51:30.757ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62462024-12-21T07:51:30.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
62472024-12-21T07:51:30.760ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62482024-12-21T07:51:30.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62492024-12-21T07:51:30.761ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 94.91153ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62502024-12-21T07:51:30.762ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.341016ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62512024-12-21T07:51:30.763ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 96.148089ms iteration = 18 status = 0
62522024-12-21T07:51:30.767ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62532024-12-21T07:51:30.767ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
62542024-12-21T07:51:30.767ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 100.578354ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
62552024-12-21T07:51:30.769ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
62562024-12-21T07:51:30.769ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62572024-12-21T07:51:30.769ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ae07d0a-3759-49e8-8b88-bf5db52748cc", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:30 GMT"} })
62582024-12-21T07:51:30.769ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62592024-12-21T07:51:30.770ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62602024-12-21T07:51:30.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62612024-12-21T07:51:30.771ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
62622024-12-21T07:51:30.771ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
62632024-12-21T07:51:30.771ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62642024-12-21T07:51:30.772ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1600630-5ce8-46c4-aa04-9dde7c6c5416", "content-length": "26", "date": "Sat, 21 Dec 2024 07:51:30 GMT"} })
62652024-12-21T07:51:30.772ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62662024-12-21T07:51:30.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 105.449085ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
62672024-12-21T07:51:30.773ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62682024-12-21T07:51:30.778ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62692024-12-21T07:51:30.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62702024-12-21T07:51:30.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62712024-12-21T07:51:30.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62722024-12-21T07:51:30.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62732024-12-21T07:51:30.795ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62742024-12-21T07:51:30.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62752024-12-21T07:51:30.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62762024-12-21T07:51:30.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62772024-12-21T07:51:30.799ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62782024-12-21T07:51:30.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62792024-12-21T07:51:30.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62802024-12-21T07:51:30.868ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 201.552904ms iteration = 21 status = {"physical_disks_added":0}
62812024-12-21T07:51:30.870ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 203.816621ms iteration = 18 status = {}
62822024-12-21T07:51:30.875ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
62832024-12-21T07:51:30.875ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62842024-12-21T07:51:30.875ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9ed4096-fd16-458c-9406-3e25be003e86", "content-length": "372", "date": "Sat, 21 Dec 2024 07:51:29 GMT"} })
62852024-12-21T07:51:30.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62862024-12-21T07:51:30.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62872024-12-21T07:51:30.890ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62882024-12-21T07:51:30.890ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "16464bb4-2d83-4931-b435-782d92e2b54c", "content-length": "1", "date": "Sat, 21 Dec 2024 07:51:30 GMT"} })
62892024-12-21T07:51:30.893ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62902024-12-21T07:51:30.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62912024-12-21T07:51:30.900ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 233.293481ms iteration = 18 status = null
62922024-12-21T07:51:30.925ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
62932024-12-21T07:51:30.925ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
62942024-12-21T07:51:30.925ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d295d19b-21e4-4806-bf05-00781d34957f", "date": "Sat, 21 Dec 2024 07:51:30 GMT"} })
62952024-12-21T07:51:30.925ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62962024-12-21T07:51:30.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62972024-12-21T07:51:30.928ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62982024-12-21T07:51:30.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62992024-12-21T07:51:30.931ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63002024-12-21T07:51:30.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63012024-12-21T07:51:30.934ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
63022024-12-21T07:51:30.934ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63032024-12-21T07:51:30.934ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9a8d040e-e7af-44ac-87a4-8d481a38974e", "date": "Sat, 21 Dec 2024 07:51:30 GMT"} })
63042024-12-21T07:51:30.936ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 269.908991ms iteration = 19 status = {}
63052024-12-21T07:51:30.944ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63062024-12-21T07:51:30.944ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "31185c08-4c19-42c1-b15e-1845082971af", "content-length": "691", "date": "Sat, 21 Dec 2024 07:51:30 GMT"} })
63072024-12-21T07:51:30.944ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
63082024-12-21T07:51:30.944ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
63092024-12-21T07:51:30.944ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
63102024-12-21T07:51:30.947ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 280.125061ms iteration = 18 status = {}
63112024-12-21T07:51:30.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7b3d9d87-c83a-40f6-b6fc-5cb41a28d3ee roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63122024-12-21T07:51:30.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7b3d9d87-c83a-40f6-b6fc-5cb41a28d3ee resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63132024-12-21T07:51:30.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7b3d9d87-c83a-40f6-b6fc-5cb41a28d3ee response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63142024-12-21T07:51:30.976ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63152024-12-21T07:51:30.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63162024-12-21T07:51:30.978ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
63172024-12-21T07:51:30.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63182024-12-21T07:51:30.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63192024-12-21T07:51:30.988ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63202024-12-21T07:51:30.989ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a22a1735-b3d6-4b45-b915-b8ba5e6a62cc", "content-length": "134", "date": "Sat, 21 Dec 2024 07:51:30 GMT"} })
63212024-12-21T07:51:30.989ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
63222024-12-21T07:51:30.989ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
63232024-12-21T07:51:30.989ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
63242024-12-21T07:51:30.989ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63252024-12-21T07:51:30.989ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63262024-12-21T07:51:30.989ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63272024-12-21T07:51:30.989ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63282024-12-21T07:51:30.989ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63292024-12-21T07:51:30.989ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63302024-12-21T07:51:30.989ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63312024-12-21T07:51:30.989ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
63322024-12-21T07:51:30.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63332024-12-21T07:51:30.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63342024-12-21T07:51:30.991ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63352024-12-21T07:51:30.992ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f35800b3-95f7-466b-9a65-9c359ad23f0b", "content-length": "2", "date": "Sat, 21 Dec 2024 07:51:30 GMT"} })
63362024-12-21T07:51:30.992ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63372024-12-21T07:51:30.992ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f3324bd-889d-4e79-8067-d40628628215", "content-length": "52", "date": "Sat, 21 Dec 2024 07:51:30 GMT"} })
63382024-12-21T07:51:30.992ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
63392024-12-21T07:51:30.992ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63402024-12-21T07:51:31.089ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "03d86b16-3dff-4c83-90b8-4c2d37101b9c", "date": "Sat, 21 Dec 2024 07:51:30 GMT"} })
63412024-12-21T07:51:31.089ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
63422024-12-21T07:51:31.089ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63432024-12-21T07:51:31.090ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf1e7e6e-094e-45a0-9bc1-5b6cc5862b23", "content-length": "682", "date": "Sat, 21 Dec 2024 07:51:31 GMT"} })
63442024-12-21T07:51:31.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63452024-12-21T07:51:31.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63462024-12-21T07:51:31.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63472024-12-21T07:51:31.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63482024-12-21T07:51:31.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63492024-12-21T07:51:31.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63502024-12-21T07:51:31.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63512024-12-21T07:51:31.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63522024-12-21T07:51:31.108ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 442.002624ms iteration = 18 status = {}
63532024-12-21T07:51:31.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9400cff1-86a4-40de-a56e-6b1c847f0c9c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63542024-12-21T07:51:31.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9400cff1-86a4-40de-a56e-6b1c847f0c9c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63552024-12-21T07:51:31.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9400cff1-86a4-40de-a56e-6b1c847f0c9c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63562024-12-21T07:51:33.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 22ddcef2-c345-41e7-89a4-9e5fad546883 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63572024-12-21T07:51:33.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 22ddcef2-c345-41e7-89a4-9e5fad546883 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63582024-12-21T07:51:33.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 22ddcef2-c345-41e7-89a4-9e5fad546883 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63592024-12-21T07:51:34.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b4db8e36-de2e-46d8-a845-17676ba7602e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63602024-12-21T07:51:34.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b4db8e36-de2e-46d8-a845-17676ba7602e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63612024-12-21T07:51:34.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b4db8e36-de2e-46d8-a845-17676ba7602e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63622024-12-21T07:51:34.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 03e89ac1-8a67-496d-bd24-c811c9a862dd roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
63632024-12-21T07:51:34.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 03e89ac1-8a67-496d-bd24-c811c9a862dd resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
63642024-12-21T07:51:34.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 03e89ac1-8a67-496d-bd24-c811c9a862dd response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
63652024-12-21T07:51:34.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = cc56996a-048c-4183-826c-8ab6b5a897db roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
63662024-12-21T07:51:34.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = cc56996a-048c-4183-826c-8ab6b5a897db resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
63672024-12-21T07:51:34.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = cc56996a-048c-4183-826c-8ab6b5a897db response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
63682024-12-21T07:51:35.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4811ddf1-fe1b-4d8e-8711-9a24b8cf2e90 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63692024-12-21T07:51:35.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4811ddf1-fe1b-4d8e-8711-9a24b8cf2e90 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63702024-12-21T07:51:35.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4811ddf1-fe1b-4d8e-8711-9a24b8cf2e90 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63712024-12-21T07:51:36.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8c35dd43-9bbe-4b4f-9cea-1f83434d0ac5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63722024-12-21T07:51:36.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8c35dd43-9bbe-4b4f-9cea-1f83434d0ac5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63732024-12-21T07:51:36.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8c35dd43-9bbe-4b4f-9cea-1f83434d0ac5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63742024-12-21T07:51:37.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8d0054d7-c769-4e9e-baed-5902680306b4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63752024-12-21T07:51:37.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8d0054d7-c769-4e9e-baed-5902680306b4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63762024-12-21T07:51:37.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8d0054d7-c769-4e9e-baed-5902680306b4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63772024-12-21T07:51:38.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 99af264f-0947-481d-8174-8f5eee4c55bd roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63782024-12-21T07:51:38.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 99af264f-0947-481d-8174-8f5eee4c55bd resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63792024-12-21T07:51:38.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 99af264f-0947-481d-8174-8f5eee4c55bd response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63802024-12-21T07:51:39.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5437b1ce-00d6-4b58-8030-9c3cd653aeca roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63812024-12-21T07:51:39.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5437b1ce-00d6-4b58-8030-9c3cd653aeca resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63822024-12-21T07:51:39.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5437b1ce-00d6-4b58-8030-9c3cd653aeca response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63832024-12-21T07:51:39.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1483 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 3485736a-38a4-48e3-9edb-a87c08ac4100 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
63842024-12-21T07:51:40.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f0646c60-0351-42ba-9427-cb257756b55c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63852024-12-21T07:51:40.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f0646c60-0351-42ba-9427-cb257756b55c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63862024-12-21T07:51:40.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f0646c60-0351-42ba-9427-cb257756b55c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
63872024-12-21T07:51:40.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
63882024-12-21T07:51:40.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
63892024-12-21T07:51:40.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63902024-12-21T07:51:40.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63912024-12-21T07:51:40.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63922024-12-21T07:51:40.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63932024-12-21T07:51:40.698ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63942024-12-21T07:51:40.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63952024-12-21T07:51:40.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63962024-12-21T07:51:40.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63972024-12-21T07:51:40.706ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63982024-12-21T07:51:40.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63992024-12-21T07:51:40.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64002024-12-21T07:51:40.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64012024-12-21T07:51:40.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64022024-12-21T07:51:40.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
64032024-12-21T07:51:40.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64042024-12-21T07:51:40.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64052024-12-21T07:51:40.727ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
64062024-12-21T07:51:40.727ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.286559ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
64072024-12-21T07:51:40.732ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.031009ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64082024-12-21T07:51:41.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2d2dea7-8e13-4282-8397-f4c2d0606306 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64092024-12-21T07:51:41.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2d2dea7-8e13-4282-8397-f4c2d0606306 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64102024-12-21T07:51:41.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2d2dea7-8e13-4282-8397-f4c2d0606306 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64112024-12-21T07:51:42.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e2fec59a-9be6-4b7c-9fc5-e51465986ae0 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64122024-12-21T07:51:42.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e2fec59a-9be6-4b7c-9fc5-e51465986ae0 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64132024-12-21T07:51:42.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1845 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e2fec59a-9be6-4b7c-9fc5-e51465986ae0 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64142024-12-21T07:51:43.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ba98914c-5ea6-4a45-81d1-62eb1aee013a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64152024-12-21T07:51:43.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ba98914c-5ea6-4a45-81d1-62eb1aee013a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64162024-12-21T07:51:43.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ba98914c-5ea6-4a45-81d1-62eb1aee013a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64172024-12-21T07:51:44.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9a4ddc3a-aeb7-4ada-bb05-dbc1f0a1e073 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64182024-12-21T07:51:44.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9a4ddc3a-aeb7-4ada-bb05-dbc1f0a1e073 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64192024-12-21T07:51:44.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9a4ddc3a-aeb7-4ada-bb05-dbc1f0a1e073 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64202024-12-21T07:51:45.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5bd7871b-8020-4b03-bfaf-99c9fadded43 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64212024-12-21T07:51:45.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5bd7871b-8020-4b03-bfaf-99c9fadded43 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64222024-12-21T07:51:45.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5bd7871b-8020-4b03-bfaf-99c9fadded43 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64232024-12-21T07:51:46.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c6e008a8-7181-4bc2-a53b-ceb5a6897a25 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64242024-12-21T07:51:46.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c6e008a8-7181-4bc2-a53b-ceb5a6897a25 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64252024-12-21T07:51:46.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2726 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c6e008a8-7181-4bc2-a53b-ceb5a6897a25 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64262024-12-21T07:51:47.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6e8fce87-6558-4f59-b936-96ca1640cf23 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64272024-12-21T07:51:47.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6e8fce87-6558-4f59-b936-96ca1640cf23 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64282024-12-21T07:51:47.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6e8fce87-6558-4f59-b936-96ca1640cf23 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64292024-12-21T07:51:48.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ea2b3fd8-e52b-448f-9e97-4f639248be99 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64302024-12-21T07:51:48.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ea2b3fd8-e52b-448f-9e97-4f639248be99 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64312024-12-21T07:51:48.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ea2b3fd8-e52b-448f-9e97-4f639248be99 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64322024-12-21T07:51:49.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dd958f9a-b06c-4f00-abe6-2b0c66ebb77a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64332024-12-21T07:51:49.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dd958f9a-b06c-4f00-abe6-2b0c66ebb77a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64342024-12-21T07:51:49.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dd958f9a-b06c-4f00-abe6-2b0c66ebb77a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64352024-12-21T07:51:49.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1348 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = b20a2564-cc5b-42e6-ba4c-6ac38f86c636 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
64362024-12-21T07:51:50.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 50142956-9f41-4292-ad30-e513d1ca49a0 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64372024-12-21T07:51:50.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 50142956-9f41-4292-ad30-e513d1ca49a0 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64382024-12-21T07:51:50.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 50142956-9f41-4292-ad30-e513d1ca49a0 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64392024-12-21T07:51:50.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
64402024-12-21T07:51:50.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64412024-12-21T07:51:50.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
64422024-12-21T07:51:50.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64432024-12-21T07:51:50.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64442024-12-21T07:51:50.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64452024-12-21T07:51:50.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64462024-12-21T07:51:50.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64472024-12-21T07:51:50.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.500871ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64482024-12-21T07:51:50.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64492024-12-21T07:51:50.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64502024-12-21T07:51:50.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64512024-12-21T07:51:50.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64522024-12-21T07:51:50.707ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64532024-12-21T07:51:50.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64542024-12-21T07:51:50.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64552024-12-21T07:51:50.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
64562024-12-21T07:51:50.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64572024-12-21T07:51:50.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64582024-12-21T07:51:50.722ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
64592024-12-21T07:51:50.722ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.299807ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
64602024-12-21T07:51:51.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 33a7545f-5845-4501-9851-6afc9b555285 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64612024-12-21T07:51:51.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 33a7545f-5845-4501-9851-6afc9b555285 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64622024-12-21T07:51:51.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 33a7545f-5845-4501-9851-6afc9b555285 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64632024-12-21T07:51:52.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3e043340-87a2-408e-94fd-e762950d7309 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64642024-12-21T07:51:52.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3e043340-87a2-408e-94fd-e762950d7309 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64652024-12-21T07:51:52.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3e043340-87a2-408e-94fd-e762950d7309 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64662024-12-21T07:51:53.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6a90bfcd-cc01-4733-9480-534f5e1a6c99 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64672024-12-21T07:51:53.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6a90bfcd-cc01-4733-9480-534f5e1a6c99 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64682024-12-21T07:51:53.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6a90bfcd-cc01-4733-9480-534f5e1a6c99 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64692024-12-21T07:51:54.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ecafef5a-c080-4dd2-bc6c-ca941b66bf53 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64702024-12-21T07:51:54.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ecafef5a-c080-4dd2-bc6c-ca941b66bf53 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64712024-12-21T07:51:54.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ecafef5a-c080-4dd2-bc6c-ca941b66bf53 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64722024-12-21T07:51:55.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 637f5b67-57b8-4e39-b9bc-278ed1d872cb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64732024-12-21T07:51:55.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 637f5b67-57b8-4e39-b9bc-278ed1d872cb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64742024-12-21T07:51:55.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 637f5b67-57b8-4e39-b9bc-278ed1d872cb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64752024-12-21T07:51:56.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = caa67df0-a177-4a25-928c-18c09b710298 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64762024-12-21T07:51:56.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = caa67df0-a177-4a25-928c-18c09b710298 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64772024-12-21T07:51:56.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = caa67df0-a177-4a25-928c-18c09b710298 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64782024-12-21T07:51:57.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6de454bf-b9ae-41d9-8cea-f7daacaaf2d5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64792024-12-21T07:51:57.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6de454bf-b9ae-41d9-8cea-f7daacaaf2d5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64802024-12-21T07:51:57.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6de454bf-b9ae-41d9-8cea-f7daacaaf2d5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64812024-12-21T07:51:58.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ecc8e59b-ea76-42d6-becf-32cce3393310 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64822024-12-21T07:51:58.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ecc8e59b-ea76-42d6-becf-32cce3393310 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64832024-12-21T07:51:58.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ecc8e59b-ea76-42d6-becf-32cce3393310 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64842024-12-21T07:51:59.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f9aa6dcd-f90a-465f-8c6b-2ae73d28c39b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64852024-12-21T07:51:59.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f9aa6dcd-f90a-465f-8c6b-2ae73d28c39b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64862024-12-21T07:51:59.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2746 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f9aa6dcd-f90a-465f-8c6b-2ae73d28c39b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64872024-12-21T07:51:59.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1665 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 28a743e0-6ff7-4441-b387-4160ed7a83ce response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
64882024-12-21T07:52:00.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 60935fe8-6b24-42ba-b8c1-f384d6a46439 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64892024-12-21T07:52:00.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 60935fe8-6b24-42ba-b8c1-f384d6a46439 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64902024-12-21T07:52:00.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 60935fe8-6b24-42ba-b8c1-f384d6a46439 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
64912024-12-21T07:52:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
64922024-12-21T07:52:00.666ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
64932024-12-21T07:52:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
64942024-12-21T07:52:00.666ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
64952024-12-21T07:52:00.666ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
64962024-12-21T07:52:00.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
64972024-12-21T07:52:00.666ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
64982024-12-21T07:52:00.666ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
64992024-12-21T07:52:00.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65002024-12-21T07:52:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
65012024-12-21T07:52:00.666ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
65022024-12-21T07:52:00.666ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
65032024-12-21T07:52:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65042024-12-21T07:52:00.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65052024-12-21T07:52:00.666ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
65062024-12-21T07:52:00.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
65072024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65082024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
65092024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65102024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
65112024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
65122024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65132024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
65142024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
65152024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
65162024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
65172024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
65182024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
65192024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65202024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
65212024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65222024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
65232024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
65242024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65252024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
65262024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
65272024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65282024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
65292024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
65302024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65312024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
65322024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
65332024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65342024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
65352024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65362024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
65372024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
65382024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
65392024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
65402024-12-21T07:52:00.667ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
65412024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
65422024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
65432024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
65442024-12-21T07:52:00.667ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:42:00.667185566 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
65452024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65462024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
65472024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
65482024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
65492024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65502024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
65512024-12-21T07:52:00.667ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b
65522024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.731\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b"}
65532024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
65542024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
65552024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65562024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65572024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65582024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65592024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
65602024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65612024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65622024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65632024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65642024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65652024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65662024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65672024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
65682024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65692024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65702024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65712024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
65722024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
65732024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65742024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65752024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65762024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65772024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65782024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65792024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65802024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
65812024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65822024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65832024-12-21T07:52:00.667ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dd95bbd-e009-486c-8c96-451a6e195a49.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1454, tv_nsec: 367160343 } })
65842024-12-21T07:52:00.667ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bfae345-1659-4377-bca9-c55abec2aeb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7c426166-4f75-4a87-b9ac-c0d590aea49b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1454, tv_nsec: 367164353 } })
65852024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
65862024-12-21T07:52:00.667ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65872024-12-21T07:52:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
65882024-12-21T07:52:00.668ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65892024-12-21T07:52:00.668ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
65902024-12-21T07:52:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.251151ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
65912024-12-21T07:52:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
65922024-12-21T07:52:00.668ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
65932024-12-21T07:52:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.357983ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
65942024-12-21T07:52:00.670ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.383476ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
65952024-12-21T07:52:00.670ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.713392ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
65962024-12-21T07:52:00.671ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.398733ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
65972024-12-21T07:52:00.674ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1454, tv_nsec: 373373686 } })
65982024-12-21T07:52:00.674ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65992024-12-21T07:52:00.674ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
66002024-12-21T07:52:00.675ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66012024-12-21T07:52:00.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66022024-12-21T07:52:00.676ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1454, tv_nsec: 375903398 } })
66032024-12-21T07:52:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66042024-12-21T07:52:00.676ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
66052024-12-21T07:52:00.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
66062024-12-21T07:52:00.677ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66072024-12-21T07:52:00.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66082024-12-21T07:52:00.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
66092024-12-21T07:52:00.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66102024-12-21T07:52:00.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66112024-12-21T07:52:00.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66122024-12-21T07:52:00.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66132024-12-21T07:52:00.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 2ec885fa-6f70-47a4-b24f-a81e55f2c1f0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
66142024-12-21T07:52:00.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 2ec885fa-6f70-47a4-b24f-a81e55f2c1f0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
66152024-12-21T07:52:00.689ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:42:00.667185566 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
66162024-12-21T07:52:00.689ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 22.547585ms iteration = 10 status = {"expiration":"2024-12-21T07:42:00.667185566Z","pruned":[]}
66172024-12-21T07:52:00.690ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66182024-12-21T07:52:00.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
66192024-12-21T07:52:00.693ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
66202024-12-21T07:52:00.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
66212024-12-21T07:52:00.695ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66222024-12-21T07:52:00.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
66232024-12-21T07:52:00.699ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66242024-12-21T07:52:00.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66252024-12-21T07:52:00.700ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66262024-12-21T07:52:00.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
66272024-12-21T07:52:00.702ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66282024-12-21T07:52:00.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66292024-12-21T07:52:00.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66302024-12-21T07:52:00.707ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66312024-12-21T07:52:00.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66322024-12-21T07:52:00.710ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66332024-12-21T07:52:00.713ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66342024-12-21T07:52:00.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66352024-12-21T07:52:00.716ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66362024-12-21T07:52:00.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66372024-12-21T07:52:00.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
66382024-12-21T07:52:00.718ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66392024-12-21T07:52:00.718ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66402024-12-21T07:52:00.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66412024-12-21T07:52:00.720ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66422024-12-21T07:52:00.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66432024-12-21T07:52:00.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66442024-12-21T07:52:00.721ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
66452024-12-21T07:52:00.721ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66462024-12-21T07:52:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66472024-12-21T07:52:00.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66482024-12-21T07:52:00.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66492024-12-21T07:52:00.723ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
66502024-12-21T07:52:00.723ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
66512024-12-21T07:52:00.723ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 56.469309ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
66522024-12-21T07:52:00.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66532024-12-21T07:52:00.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66542024-12-21T07:52:00.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 2ec885fa-6f70-47a4-b24f-a81e55f2c1f0 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
66552024-12-21T07:52:00.728ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66562024-12-21T07:52:00.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66572024-12-21T07:52:00.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66582024-12-21T07:52:00.730ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66592024-12-21T07:52:00.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66602024-12-21T07:52:00.730ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
66612024-12-21T07:52:00.730ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66622024-12-21T07:52:00.730ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66632024-12-21T07:52:00.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66642024-12-21T07:52:00.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66652024-12-21T07:52:00.730ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66662024-12-21T07:52:00.731ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66672024-12-21T07:52:00.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66682024-12-21T07:52:00.733ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.08836ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
66692024-12-21T07:52:00.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
66702024-12-21T07:52:00.733ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66712024-12-21T07:52:00.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66722024-12-21T07:52:00.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66732024-12-21T07:52:00.734ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66742024-12-21T07:52:00.735ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66752024-12-21T07:52:00.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66762024-12-21T07:52:00.736ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66772024-12-21T07:52:00.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66782024-12-21T07:52:00.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66792024-12-21T07:52:00.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66802024-12-21T07:52:00.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
66812024-12-21T07:52:00.737ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66822024-12-21T07:52:00.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66832024-12-21T07:52:00.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66842024-12-21T07:52:00.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66852024-12-21T07:52:00.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66862024-12-21T07:52:00.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66872024-12-21T07:52:00.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
66882024-12-21T07:52:00.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66892024-12-21T07:52:00.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66902024-12-21T07:52:00.743ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66912024-12-21T07:52:00.743ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 76.530644ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66922024-12-21T07:52:00.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66932024-12-21T07:52:00.744ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66942024-12-21T07:52:00.745ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 78.138281ms iteration = 5 status = {"nsuccess":5}
66952024-12-21T07:52:00.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66962024-12-21T07:52:00.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66972024-12-21T07:52:00.747ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1454, tv_nsec: 446329290 } })
66982024-12-21T07:52:00.747ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
66992024-12-21T07:52:00.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
67002024-12-21T07:52:00.747ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67012024-12-21T07:52:00.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67022024-12-21T07:52:00.749ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67032024-12-21T07:52:00.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67042024-12-21T07:52:00.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
67052024-12-21T07:52:00.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67062024-12-21T07:52:00.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67072024-12-21T07:52:00.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67082024-12-21T07:52:00.753ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67092024-12-21T07:52:00.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67102024-12-21T07:52:00.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67112024-12-21T07:52:00.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67122024-12-21T07:52:00.762ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
67132024-12-21T07:52:00.762ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
67142024-12-21T07:52:00.762ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
67152024-12-21T07:52:00.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67162024-12-21T07:52:00.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67172024-12-21T07:52:00.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67182024-12-21T07:52:00.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67192024-12-21T07:52:00.764ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.421881ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67202024-12-21T07:52:00.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67212024-12-21T07:52:00.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67222024-12-21T07:52:00.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67232024-12-21T07:52:00.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67242024-12-21T07:52:00.767ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67252024-12-21T07:52:00.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67262024-12-21T07:52:00.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67272024-12-21T07:52:00.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
67282024-12-21T07:52:00.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67292024-12-21T07:52:00.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67302024-12-21T07:52:00.772ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
67312024-12-21T07:52:00.772ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 105.443174ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
67322024-12-21T07:52:00.774ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
67332024-12-21T07:52:00.774ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 106.98719ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
67342024-12-21T07:52:00.774ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 107.390667ms iteration = 19 status = 0
67352024-12-21T07:52:00.775ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
67362024-12-21T07:52:00.775ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
67372024-12-21T07:52:00.775ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
67382024-12-21T07:52:00.775ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67392024-12-21T07:52:00.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67402024-12-21T07:52:00.776ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
67412024-12-21T07:52:00.778ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67422024-12-21T07:52:00.782ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
67432024-12-21T07:52:00.782ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 115.290009ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67442024-12-21T07:52:00.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67452024-12-21T07:52:00.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67462024-12-21T07:52:00.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67472024-12-21T07:52:00.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
67482024-12-21T07:52:00.784ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
67492024-12-21T07:52:00.784ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
67502024-12-21T07:52:00.784ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
67512024-12-21T07:52:00.784ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 117.319453ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
67522024-12-21T07:52:00.785ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
67532024-12-21T07:52:00.785ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
67542024-12-21T07:52:00.785ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67552024-12-21T07:52:00.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67562024-12-21T07:52:00.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67572024-12-21T07:52:00.788ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67582024-12-21T07:52:00.788ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
67592024-12-21T07:52:00.788ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67602024-12-21T07:52:00.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67612024-12-21T07:52:00.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67622024-12-21T07:52:00.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67632024-12-21T07:52:00.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67642024-12-21T07:52:00.795ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
67652024-12-21T07:52:00.795ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
67662024-12-21T07:52:00.795ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:43:39.444085 UTC dns_group = internal generation = 1
67672024-12-21T07:52:00.795ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 128.62632ms iteration = 11 status = {"generation":1}
67682024-12-21T07:52:00.798ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67692024-12-21T07:52:00.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67702024-12-21T07:52:00.800ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67712024-12-21T07:52:00.803ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67722024-12-21T07:52:00.803ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67732024-12-21T07:52:00.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67742024-12-21T07:52:00.809ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
67752024-12-21T07:52:00.809ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67762024-12-21T07:52:00.811ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e268660-27b0-48c4-b6af-4d7a9d2365e2", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:00 GMT"} })
67772024-12-21T07:52:00.812ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67782024-12-21T07:52:00.814ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67792024-12-21T07:52:00.821ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
67802024-12-21T07:52:00.821ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 0 version = 2
67812024-12-21T07:52:00.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67822024-12-21T07:52:00.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67832024-12-21T07:52:00.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67842024-12-21T07:52:00.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67852024-12-21T07:52:00.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67862024-12-21T07:52:00.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67872024-12-21T07:52:00.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 163.48572ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
67882024-12-21T07:52:00.831ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67892024-12-21T07:52:00.832ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 1 version = 2
67902024-12-21T07:52:00.832ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
67912024-12-21T07:52:00.832ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:43:41.075205 UTC dns_group = external generation = 2
67922024-12-21T07:52:00.832ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 165.175409ms iteration = 11 status = {"generation":2}
67932024-12-21T07:52:00.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67942024-12-21T07:52:00.836ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
67952024-12-21T07:52:00.836ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67962024-12-21T07:52:00.837ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8121e347-9d4a-491c-9145-e5638c1e2407", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:00 GMT"} })
67972024-12-21T07:52:00.837ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67982024-12-21T07:52:00.839ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67992024-12-21T07:52:00.858ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68002024-12-21T07:52:00.858ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68012024-12-21T07:52:00.858ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 191.631718ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
68022024-12-21T07:52:00.863ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:42:50.264108Z, time_modified: 2024-12-21T07:42:50.264108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }) }
68032024-12-21T07:52:00.863ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 196.203324ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]}},"default_endpoint":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
68042024-12-21T07:52:00.888ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
68052024-12-21T07:52:00.889ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 221.801431ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
68062024-12-21T07:52:00.920ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 252.856857ms iteration = 22 status = {"physical_disks_added":0}
68072024-12-21T07:52:00.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68082024-12-21T07:52:00.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68092024-12-21T07:52:00.957ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68102024-12-21T07:52:00.959ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
68112024-12-21T07:52:00.960ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68122024-12-21T07:52:00.960ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68132024-12-21T07:52:00.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68142024-12-21T07:52:00.982ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
68152024-12-21T07:52:00.983ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f418e66f-1cc0-4aed-9204-098cd0a89e67", "date": "Sat, 21 Dec 2024 07:52:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
68162024-12-21T07:52:00.983ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
68172024-12-21T07:52:00.985ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "926414c9-e830-4e50-9995-647fa2b413d1", "date": "Sat, 21 Dec 2024 07:52:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
68182024-12-21T07:52:00.985ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
68192024-12-21T07:52:00.987ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
68202024-12-21T07:52:00.987ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 319.978454ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
68212024-12-21T07:52:00.996ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
68222024-12-21T07:52:00.996ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68232024-12-21T07:52:00.996ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
68242024-12-21T07:52:00.996ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "55a6e682-2d6a-46a8-afd2-16e4f90b259e", "content-length": "372", "date": "Sat, 21 Dec 2024 07:52:00 GMT"} })
68252024-12-21T07:52:00.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68262024-12-21T07:52:00.996ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c9b6457-fbe8-4351-b68c-f7bf9f6ff2ed", "content-length": "1", "date": "Sat, 21 Dec 2024 07:52:00 GMT"} })
68272024-12-21T07:52:00.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68282024-12-21T07:52:00.998ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68292024-12-21T07:52:00.999ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68302024-12-21T07:52:00.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68312024-12-21T07:52:01.001ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68322024-12-21T07:52:01.001ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68332024-12-21T07:52:01.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68342024-12-21T07:52:01.004ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 337.252501ms iteration = 19 status = null
68352024-12-21T07:52:01.020ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
68362024-12-21T07:52:01.020ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68372024-12-21T07:52:01.020ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4b7eea6-e19d-4aa4-a957-84e070701ec8", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:00 GMT"} })
68382024-12-21T07:52:01.020ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68392024-12-21T07:52:01.022ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
68402024-12-21T07:52:01.042ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 375.163362ms iteration = 19 status = {}
68412024-12-21T07:52:01.044ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
68422024-12-21T07:52:01.044ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
68432024-12-21T07:52:01.045ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "74a85618-3b3c-47cf-b513-742a4e925291", "date": "Sat, 21 Dec 2024 07:52:00 GMT"} })
68442024-12-21T07:52:01.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68452024-12-21T07:52:01.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68462024-12-21T07:52:01.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68472024-12-21T07:52:01.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68482024-12-21T07:52:01.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68492024-12-21T07:52:01.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68502024-12-21T07:52:01.053ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
68512024-12-21T07:52:01.053ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68522024-12-21T07:52:01.054ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8f1ccab2-37e9-45fe-9d27-1e5057b515f3", "date": "Sat, 21 Dec 2024 07:52:00 GMT"} })
68532024-12-21T07:52:01.055ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 388.868141ms iteration = 20 status = {}
68542024-12-21T07:52:01.061ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
68552024-12-21T07:52:01.062ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "44587a94-1bbe-49fd-9d6a-fd5450b34ae5", "date": "Sat, 21 Dec 2024 07:52:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68562024-12-21T07:52:01.062ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68572024-12-21T07:52:01.063ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9af86047-eb80-49a7-9b19-f80024e6d70a", "date": "Sat, 21 Dec 2024 07:52:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68582024-12-21T07:52:01.063ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68592024-12-21T07:52:01.065ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a89f7443-92f5-4e8b-9019-d5aaf28103ba", "date": "Sat, 21 Dec 2024 07:52:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68602024-12-21T07:52:01.065ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68612024-12-21T07:52:01.067ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68622024-12-21T07:52:01.067ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 400.177499ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
68632024-12-21T07:52:01.086ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
68642024-12-21T07:52:01.087ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf25b059-b527-4684-9454-452123230e2b", "content-length": "691", "date": "Sat, 21 Dec 2024 07:52:00 GMT"} })
68652024-12-21T07:52:01.087ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
68662024-12-21T07:52:01.087ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
68672024-12-21T07:52:01.087ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
68682024-12-21T07:52:01.089ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 421.960851ms iteration = 19 status = {}
68692024-12-21T07:52:01.161ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68702024-12-21T07:52:01.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68712024-12-21T07:52:01.164ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
68722024-12-21T07:52:01.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68732024-12-21T07:52:01.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68742024-12-21T07:52:01.174ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68752024-12-21T07:52:01.174ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc881a26-ad88-415b-8c73-18c8f73fa1e4", "content-length": "134", "date": "Sat, 21 Dec 2024 07:52:00 GMT"} })
68762024-12-21T07:52:01.174ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
68772024-12-21T07:52:01.174ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
68782024-12-21T07:52:01.175ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
68792024-12-21T07:52:01.175ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68802024-12-21T07:52:01.175ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68812024-12-21T07:52:01.175ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68822024-12-21T07:52:01.175ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68832024-12-21T07:52:01.175ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68842024-12-21T07:52:01.175ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68852024-12-21T07:52:01.175ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68862024-12-21T07:52:01.175ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
68872024-12-21T07:52:01.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68882024-12-21T07:52:01.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68892024-12-21T07:52:01.178ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
68902024-12-21T07:52:01.178ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c9b967f-7520-4892-9a17-21e897c0a166", "content-length": "2", "date": "Sat, 21 Dec 2024 07:52:00 GMT"} })
68912024-12-21T07:52:01.178ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
68922024-12-21T07:52:01.178ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "71ed312c-eaba-440b-9352-8b449ccaee2b", "content-length": "52", "date": "Sat, 21 Dec 2024 07:52:00 GMT"} })
68932024-12-21T07:52:01.178ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
68942024-12-21T07:52:01.178ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
68952024-12-21T07:52:01.276ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dbb9a3ed-594d-496d-9c88-0281709ab803", "date": "Sat, 21 Dec 2024 07:52:00 GMT"} })
68962024-12-21T07:52:01.276ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
68972024-12-21T07:52:01.276ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
68982024-12-21T07:52:01.277ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "023aa9a3-bf8f-4927-af93-c6aa56b86ee7", "content-length": "682", "date": "Sat, 21 Dec 2024 07:52:00 GMT"} })
68992024-12-21T07:52:01.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69002024-12-21T07:52:01.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69012024-12-21T07:52:01.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69022024-12-21T07:52:01.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69032024-12-21T07:52:01.285ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69042024-12-21T07:52:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69052024-12-21T07:52:01.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69062024-12-21T07:52:01.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69072024-12-21T07:52:01.294ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 627.43375ms iteration = 19 status = {}
69082024-12-21T07:52:01.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 42768b5b-c83c-48dd-89a2-e590d5595098 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69092024-12-21T07:52:01.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 42768b5b-c83c-48dd-89a2-e590d5595098 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69102024-12-21T07:52:01.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 42768b5b-c83c-48dd-89a2-e590d5595098 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69112024-12-21T07:52:02.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a2730d62-ce5c-4418-81d9-8b910b412539 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69122024-12-21T07:52:02.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a2730d62-ce5c-4418-81d9-8b910b412539 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69132024-12-21T07:52:02.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a2730d62-ce5c-4418-81d9-8b910b412539 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69142024-12-21T07:52:03.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 967e0466-74da-401a-bdb6-52bb56d82f73 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69152024-12-21T07:52:03.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 967e0466-74da-401a-bdb6-52bb56d82f73 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69162024-12-21T07:52:03.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 967e0466-74da-401a-bdb6-52bb56d82f73 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69172024-12-21T07:52:04.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = f5dc06bd-6430-4a33-83e0-ae3c89b91ae0 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
69182024-12-21T07:52:04.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = f5dc06bd-6430-4a33-83e0-ae3c89b91ae0 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
69192024-12-21T07:52:04.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = f5dc06bd-6430-4a33-83e0-ae3c89b91ae0 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
69202024-12-21T07:52:04.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 814546f4-2504-4f01-8559-39d750547198 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
69212024-12-21T07:52:04.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 814546f4-2504-4f01-8559-39d750547198 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
69222024-12-21T07:52:04.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 814546f4-2504-4f01-8559-39d750547198 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
69232024-12-21T07:52:04.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7f9198bb-2fe6-4b58-920b-e858c8d0ce57 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69242024-12-21T07:52:04.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7f9198bb-2fe6-4b58-920b-e858c8d0ce57 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69252024-12-21T07:52:04.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7f9198bb-2fe6-4b58-920b-e858c8d0ce57 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69262024-12-21T07:52:05.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 26e9dae6-aae3-436e-a826-1618d31eb174 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69272024-12-21T07:52:05.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 26e9dae6-aae3-436e-a826-1618d31eb174 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69282024-12-21T07:52:05.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 26e9dae6-aae3-436e-a826-1618d31eb174 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69292024-12-21T07:52:06.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 415f8186-320b-46ce-9fb9-e62eb486664c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69302024-12-21T07:52:06.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 415f8186-320b-46ce-9fb9-e62eb486664c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69312024-12-21T07:52:06.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 415f8186-320b-46ce-9fb9-e62eb486664c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69322024-12-21T07:52:07.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 30557935-c1b8-4b85-9433-c19f6b5ee8c7 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69332024-12-21T07:52:07.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 30557935-c1b8-4b85-9433-c19f6b5ee8c7 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69342024-12-21T07:52:07.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2785 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 30557935-c1b8-4b85-9433-c19f6b5ee8c7 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69352024-12-21T07:52:08.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3b221b3b-0b69-4d4b-b345-771e65a3664a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69362024-12-21T07:52:08.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3b221b3b-0b69-4d4b-b345-771e65a3664a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69372024-12-21T07:52:08.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3b221b3b-0b69-4d4b-b345-771e65a3664a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69382024-12-21T07:52:09.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1333 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = b6b043b5-0120-4908-b238-3a3b886ef1ee response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
69392024-12-21T07:52:09.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 60573f7c-6774-4176-a5a2-c05bc4d9e348 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69402024-12-21T07:52:09.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 60573f7c-6774-4176-a5a2-c05bc4d9e348 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69412024-12-21T07:52:09.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 60573f7c-6774-4176-a5a2-c05bc4d9e348 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69422024-12-21T07:52:10.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
69432024-12-21T07:52:10.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69442024-12-21T07:52:10.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
69452024-12-21T07:52:10.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69462024-12-21T07:52:10.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69472024-12-21T07:52:10.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69482024-12-21T07:52:10.669ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69492024-12-21T07:52:10.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69502024-12-21T07:52:10.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69512024-12-21T07:52:10.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69522024-12-21T07:52:10.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69532024-12-21T07:52:10.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69542024-12-21T07:52:10.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69552024-12-21T07:52:10.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69562024-12-21T07:52:10.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69572024-12-21T07:52:10.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
69582024-12-21T07:52:10.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69592024-12-21T07:52:10.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69602024-12-21T07:52:10.687ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
69612024-12-21T07:52:10.687ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.742536ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
69622024-12-21T07:52:10.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.102598ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69632024-12-21T07:52:10.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f29f4ae2-eed2-4b6e-a73d-fba57f13717b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69642024-12-21T07:52:10.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f29f4ae2-eed2-4b6e-a73d-fba57f13717b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69652024-12-21T07:52:10.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f29f4ae2-eed2-4b6e-a73d-fba57f13717b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69662024-12-21T07:52:11.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 45da8486-063e-4646-b3e6-fa0ab122d357 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69672024-12-21T07:52:11.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 45da8486-063e-4646-b3e6-fa0ab122d357 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69682024-12-21T07:52:11.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 45da8486-063e-4646-b3e6-fa0ab122d357 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69692024-12-21T07:52:12.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 35ba8c68-a0a3-478a-9fd9-9d01f62a7840 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69702024-12-21T07:52:12.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 35ba8c68-a0a3-478a-9fd9-9d01f62a7840 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69712024-12-21T07:52:12.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 35ba8c68-a0a3-478a-9fd9-9d01f62a7840 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69722024-12-21T07:52:13.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 70cb8f49-0ef0-476e-95c9-948f94919f59 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69732024-12-21T07:52:13.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 70cb8f49-0ef0-476e-95c9-948f94919f59 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69742024-12-21T07:52:13.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 70cb8f49-0ef0-476e-95c9-948f94919f59 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69752024-12-21T07:52:14.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8c96f19d-fd43-4364-9147-4b904b18b28a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69762024-12-21T07:52:14.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8c96f19d-fd43-4364-9147-4b904b18b28a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69772024-12-21T07:52:14.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1845 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8c96f19d-fd43-4364-9147-4b904b18b28a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69782024-12-21T07:52:15.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cc2ac1d0-a4de-4a02-89ba-471413eb93e6 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69792024-12-21T07:52:15.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cc2ac1d0-a4de-4a02-89ba-471413eb93e6 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69802024-12-21T07:52:15.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cc2ac1d0-a4de-4a02-89ba-471413eb93e6 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69812024-12-21T07:52:17.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9df723be-4dcd-4674-8c89-0e0821226421 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69822024-12-21T07:52:17.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9df723be-4dcd-4674-8c89-0e0821226421 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69832024-12-21T07:52:17.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9df723be-4dcd-4674-8c89-0e0821226421 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69842024-12-21T07:52:18.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3556e265-e4f8-4c7f-a9b8-3e6a91315c64 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69852024-12-21T07:52:18.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3556e265-e4f8-4c7f-a9b8-3e6a91315c64 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69862024-12-21T07:52:18.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3556e265-e4f8-4c7f-a9b8-3e6a91315c64 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69872024-12-21T07:52:19.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 67b62091-fc16-48e5-8553-d13ad8bde548 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69882024-12-21T07:52:19.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 67b62091-fc16-48e5-8553-d13ad8bde548 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69892024-12-21T07:52:19.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 67b62091-fc16-48e5-8553-d13ad8bde548 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69902024-12-21T07:52:19.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1363 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 76d60897-5d8b-4603-88b9-653422a35379 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
69912024-12-21T07:52:20.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c25c68b3-be51-4a61-9b03-5ced65ff1d45 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69922024-12-21T07:52:20.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c25c68b3-be51-4a61-9b03-5ced65ff1d45 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69932024-12-21T07:52:20.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c25c68b3-be51-4a61-9b03-5ced65ff1d45 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
69942024-12-21T07:52:20.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
69952024-12-21T07:52:20.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
69962024-12-21T07:52:20.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69972024-12-21T07:52:20.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69982024-12-21T07:52:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69992024-12-21T07:52:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70002024-12-21T07:52:20.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70012024-12-21T07:52:20.669ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70022024-12-21T07:52:20.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70032024-12-21T07:52:20.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70042024-12-21T07:52:20.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70052024-12-21T07:52:20.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70062024-12-21T07:52:20.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.073025ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70072024-12-21T07:52:20.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70082024-12-21T07:52:20.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70092024-12-21T07:52:20.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70102024-12-21T07:52:20.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
70112024-12-21T07:52:20.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70122024-12-21T07:52:20.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70132024-12-21T07:52:20.716ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
70142024-12-21T07:52:20.716ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.801579ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
70152024-12-21T07:52:21.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ed44296f-3c00-4081-a3bb-15ca97b3f361 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70162024-12-21T07:52:21.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ed44296f-3c00-4081-a3bb-15ca97b3f361 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70172024-12-21T07:52:21.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ed44296f-3c00-4081-a3bb-15ca97b3f361 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70182024-12-21T07:52:22.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 114b119c-90cd-49c0-aecd-735e31ccf330 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70192024-12-21T07:52:22.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 114b119c-90cd-49c0-aecd-735e31ccf330 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70202024-12-21T07:52:22.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 114b119c-90cd-49c0-aecd-735e31ccf330 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70212024-12-21T07:52:23.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5a573dcf-9807-4b3e-979b-2cd1175abe20 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70222024-12-21T07:52:23.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5a573dcf-9807-4b3e-979b-2cd1175abe20 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70232024-12-21T07:52:23.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5a573dcf-9807-4b3e-979b-2cd1175abe20 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70242024-12-21T07:52:24.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 368a7fc4-1908-44a9-8d2d-7d62ebe431f6 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70252024-12-21T07:52:24.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 368a7fc4-1908-44a9-8d2d-7d62ebe431f6 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70262024-12-21T07:52:24.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 368a7fc4-1908-44a9-8d2d-7d62ebe431f6 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70272024-12-21T07:52:25.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 229ef85f-f699-4c5b-8d81-5bcbd905dc28 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70282024-12-21T07:52:25.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 229ef85f-f699-4c5b-8d81-5bcbd905dc28 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70292024-12-21T07:52:25.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 229ef85f-f699-4c5b-8d81-5bcbd905dc28 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70302024-12-21T07:52:26.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6edf46ca-2422-4db0-953b-92b7d4f4344a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70312024-12-21T07:52:26.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6edf46ca-2422-4db0-953b-92b7d4f4344a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70322024-12-21T07:52:26.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6edf46ca-2422-4db0-953b-92b7d4f4344a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70332024-12-21T07:52:27.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 83c3f9ab-aa95-42a6-87b6-62fe74dfa7f5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70342024-12-21T07:52:27.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 83c3f9ab-aa95-42a6-87b6-62fe74dfa7f5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70352024-12-21T07:52:27.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 83c3f9ab-aa95-42a6-87b6-62fe74dfa7f5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70362024-12-21T07:52:28.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = de50cf18-8473-4fbe-b5e8-197271133426 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70372024-12-21T07:52:28.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = de50cf18-8473-4fbe-b5e8-197271133426 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70382024-12-21T07:52:28.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = de50cf18-8473-4fbe-b5e8-197271133426 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70392024-12-21T07:52:29.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 75e43b17-60c9-4d1e-b8b8-7fb9f8ee6536 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70402024-12-21T07:52:29.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 75e43b17-60c9-4d1e-b8b8-7fb9f8ee6536 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70412024-12-21T07:52:29.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 75e43b17-60c9-4d1e-b8b8-7fb9f8ee6536 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70422024-12-21T07:52:29.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1512 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = cf0b54ac-e611-46b2-a201-eb4db1fe2f1b response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
70432024-12-21T07:52:30.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c86173f7-36c9-4691-ae79-a267a519282b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70442024-12-21T07:52:30.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c86173f7-36c9-4691-ae79-a267a519282b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70452024-12-21T07:52:30.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c86173f7-36c9-4691-ae79-a267a519282b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
70462024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
70472024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70482024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
70492024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
70502024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
70512024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70522024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70532024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70542024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
70552024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
70562024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70572024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
70582024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
70592024-12-21T07:52:30.666ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
70602024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70612024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70622024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
70632024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
70642024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70652024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70662024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
70672024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
70682024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70692024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
70702024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
70712024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
70722024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
70732024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
70742024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70752024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
70762024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70772024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
70782024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
70792024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
70802024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70812024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70822024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70832024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70842024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70852024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70862024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70872024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70882024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70892024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
70902024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
70912024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70922024-12-21T07:52:30.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
70932024-12-21T07:52:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70942024-12-21T07:52:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70952024-12-21T07:52:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70962024-12-21T07:52:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70972024-12-21T07:52:30.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70982024-12-21T07:52:30.670ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70992024-12-21T07:52:30.670ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71002024-12-21T07:52:30.670ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71012024-12-21T07:52:30.670ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.995796ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71022024-12-21T07:52:30.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71032024-12-21T07:52:30.671ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 370509252 } })
71042024-12-21T07:52:30.671ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
71052024-12-21T07:52:30.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71062024-12-21T07:52:30.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71072024-12-21T07:52:30.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71082024-12-21T07:52:30.673ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71092024-12-21T07:52:30.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
71102024-12-21T07:52:30.676ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71112024-12-21T07:52:30.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71122024-12-21T07:52:30.679ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 378313931 } })
71132024-12-21T07:52:30.679ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
71142024-12-21T07:52:30.679ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71152024-12-21T07:52:30.681ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71162024-12-21T07:52:30.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71172024-12-21T07:52:30.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71182024-12-21T07:52:30.682ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71192024-12-21T07:52:30.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71202024-12-21T07:52:30.683ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71212024-12-21T07:52:30.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71222024-12-21T07:52:30.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71232024-12-21T07:52:30.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
71242024-12-21T07:52:30.686ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71252024-12-21T07:52:30.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71262024-12-21T07:52:30.689ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71272024-12-21T07:52:30.689ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
71282024-12-21T07:52:30.689ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71292024-12-21T07:52:30.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71302024-12-21T07:52:30.702ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
71312024-12-21T07:52:30.702ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.854776ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
71322024-12-21T07:52:30.702ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71332024-12-21T07:52:30.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71342024-12-21T07:52:30.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.026806ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
71352024-12-21T07:52:30.713ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71362024-12-21T07:52:30.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71372024-12-21T07:52:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71382024-12-21T07:52:30.714ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71392024-12-21T07:52:30.716ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71402024-12-21T07:52:30.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71412024-12-21T07:52:30.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71422024-12-21T07:52:30.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
71432024-12-21T07:52:30.716ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71442024-12-21T07:52:30.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71452024-12-21T07:52:30.717ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71462024-12-21T07:52:30.717ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71472024-12-21T07:52:30.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71482024-12-21T07:52:30.717ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71492024-12-21T07:52:30.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71502024-12-21T07:52:30.718ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.579825ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
71512024-12-21T07:52:30.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71522024-12-21T07:52:30.719ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71532024-12-21T07:52:30.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71542024-12-21T07:52:30.720ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71552024-12-21T07:52:30.720ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 419986965 } })
71562024-12-21T07:52:30.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71572024-12-21T07:52:30.721ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
71582024-12-21T07:52:30.721ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71592024-12-21T07:52:30.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71602024-12-21T07:52:30.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71612024-12-21T07:52:30.722ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71622024-12-21T07:52:30.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71632024-12-21T07:52:30.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
71642024-12-21T07:52:30.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71652024-12-21T07:52:30.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71662024-12-21T07:52:30.726ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
71672024-12-21T07:52:30.726ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.001458ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
71682024-12-21T07:52:30.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.042626ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71692024-12-21T07:52:30.727ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71702024-12-21T07:52:30.727ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71712024-12-21T07:52:30.727ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 61.444643ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71722024-12-21T07:52:30.727ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 61.753338ms iteration = 20 status = 0
71732024-12-21T07:52:30.739ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71742024-12-21T07:52:30.739ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71752024-12-21T07:52:30.739ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fe5c032-72fe-4bf4-98d2-7c4e04592da8", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:30 GMT"} })
71762024-12-21T07:52:30.739ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71772024-12-21T07:52:30.741ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71782024-12-21T07:52:30.743ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 77.332076ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71792024-12-21T07:52:30.749ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71802024-12-21T07:52:30.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71812024-12-21T07:52:30.751ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.648325ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71822024-12-21T07:52:30.752ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71832024-12-21T07:52:30.753ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71842024-12-21T07:52:30.756ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71852024-12-21T07:52:30.756ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71862024-12-21T07:52:30.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71872024-12-21T07:52:30.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71882024-12-21T07:52:30.757ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71892024-12-21T07:52:30.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71902024-12-21T07:52:30.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = ceea3da3-cdf9-47d3-970b-6bcf2a677427 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
71912024-12-21T07:52:30.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = ceea3da3-cdf9-47d3-970b-6bcf2a677427 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
71922024-12-21T07:52:30.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = ceea3da3-cdf9-47d3-970b-6bcf2a677427 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
71932024-12-21T07:52:30.764ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71942024-12-21T07:52:30.764ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71952024-12-21T07:52:30.764ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "834ea79d-6062-4efd-aec8-0263e487e750", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:30 GMT"} })
71962024-12-21T07:52:30.764ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71972024-12-21T07:52:30.766ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71982024-12-21T07:52:30.780ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 114.614447ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
71992024-12-21T07:52:30.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72002024-12-21T07:52:30.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72012024-12-21T07:52:30.805ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
72022024-12-21T07:52:30.805ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72032024-12-21T07:52:30.805ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "544d25e3-eba6-4ac1-9330-ed1bb5fd3a09", "content-length": "26", "date": "Sat, 21 Dec 2024 07:52:30 GMT"} })
72042024-12-21T07:52:30.805ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72052024-12-21T07:52:30.807ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
72062024-12-21T07:52:30.817ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72072024-12-21T07:52:30.817ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1155705-b13a-4a78-ac04-af44a03b8cb3", "content-length": "1", "date": "Sat, 21 Dec 2024 07:52:29 GMT"} })
72082024-12-21T07:52:30.818ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72092024-12-21T07:52:30.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72102024-12-21T07:52:30.824ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 158.094111ms iteration = 20 status = null
72112024-12-21T07:52:30.845ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 178.874376ms iteration = 20 status = {}
72122024-12-21T07:52:30.873ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 206.823191ms iteration = 23 status = {"physical_disks_added":0}
72132024-12-21T07:52:30.903ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
72142024-12-21T07:52:30.903ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72152024-12-21T07:52:30.903ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a01faff7-132e-4d5b-96d2-354ccf47f563", "content-length": "372", "date": "Sat, 21 Dec 2024 07:52:30 GMT"} })
72162024-12-21T07:52:30.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72172024-12-21T07:52:30.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72182024-12-21T07:52:30.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72192024-12-21T07:52:30.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72202024-12-21T07:52:30.922ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72212024-12-21T07:52:30.927ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72222024-12-21T07:52:30.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72232024-12-21T07:52:30.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72242024-12-21T07:52:30.928ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72252024-12-21T07:52:30.930ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72262024-12-21T07:52:30.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72272024-12-21T07:52:30.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72282024-12-21T07:52:30.952ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
72292024-12-21T07:52:30.952ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
72302024-12-21T07:52:30.952ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "11cbf173-4d7b-4786-92b7-60c95e1d1821", "date": "Sat, 21 Dec 2024 07:52:30 GMT"} })
72312024-12-21T07:52:30.952ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72322024-12-21T07:52:30.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72332024-12-21T07:52:30.955ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72342024-12-21T07:52:30.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72352024-12-21T07:52:30.958ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72362024-12-21T07:52:30.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72372024-12-21T07:52:30.960ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
72382024-12-21T07:52:30.960ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72392024-12-21T07:52:30.961ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2704db86-81de-462d-8cf4-4e13a2ba26a7", "date": "Sat, 21 Dec 2024 07:52:30 GMT"} })
72402024-12-21T07:52:30.962ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 296.491623ms iteration = 21 status = {}
72412024-12-21T07:52:30.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72422024-12-21T07:52:30.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72432024-12-21T07:52:30.985ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
72442024-12-21T07:52:30.985ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72452024-12-21T07:52:30.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72462024-12-21T07:52:30.989ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72472024-12-21T07:52:30.989ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bd745f6-5b7e-4f29-a102-672830a7cfce", "content-length": "691", "date": "Sat, 21 Dec 2024 07:52:30 GMT"} })
72482024-12-21T07:52:30.989ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
72492024-12-21T07:52:30.989ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
72502024-12-21T07:52:30.989ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
72512024-12-21T07:52:30.990ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 324.55446ms iteration = 20 status = {}
72522024-12-21T07:52:30.999ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72532024-12-21T07:52:30.999ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4d6ef4b-a362-4959-96c3-f5be31df9226", "content-length": "134", "date": "Sat, 21 Dec 2024 07:52:30 GMT"} })
72542024-12-21T07:52:30.999ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
72552024-12-21T07:52:30.999ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
72562024-12-21T07:52:30.999ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72572024-12-21T07:52:30.999ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72582024-12-21T07:52:30.999ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72592024-12-21T07:52:30.999ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72602024-12-21T07:52:30.999ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72612024-12-21T07:52:30.999ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72622024-12-21T07:52:30.999ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72632024-12-21T07:52:30.999ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72642024-12-21T07:52:31.000ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
72652024-12-21T07:52:31.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72662024-12-21T07:52:31.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72672024-12-21T07:52:31.002ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72682024-12-21T07:52:31.002ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "31da097b-f429-4a0f-ac87-d869ac941d40", "content-length": "2", "date": "Sat, 21 Dec 2024 07:52:30 GMT"} })
72692024-12-21T07:52:31.002ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72702024-12-21T07:52:31.002ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bbb103b-9fcb-4aaa-a306-55dd10c2d3b3", "content-length": "52", "date": "Sat, 21 Dec 2024 07:52:30 GMT"} })
72712024-12-21T07:52:31.002ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
72722024-12-21T07:52:31.002ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72732024-12-21T07:52:31.100ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cf89c804-0348-42c3-81e4-ce4ca8390295", "date": "Sat, 21 Dec 2024 07:52:30 GMT"} })
72742024-12-21T07:52:31.100ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
72752024-12-21T07:52:31.100ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72762024-12-21T07:52:31.101ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1daa3bee-fa6b-4a45-a0ad-150c4805e086", "content-length": "682", "date": "Sat, 21 Dec 2024 07:52:31 GMT"} })
72772024-12-21T07:52:31.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72782024-12-21T07:52:31.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72792024-12-21T07:52:31.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72802024-12-21T07:52:31.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72812024-12-21T07:52:31.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72822024-12-21T07:52:31.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72832024-12-21T07:52:31.117ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72842024-12-21T07:52:31.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72852024-12-21T07:52:31.124ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 458.103852ms iteration = 20 status = {}
72862024-12-21T07:52:31.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4de0197f-4f45-4e89-8563-9f25d7d88314 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
72872024-12-21T07:52:31.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4de0197f-4f45-4e89-8563-9f25d7d88314 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
72882024-12-21T07:52:31.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1884 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4de0197f-4f45-4e89-8563-9f25d7d88314 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
72892024-12-21T07:52:32.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 410008d5-7166-402e-b91f-4785e5b5b8f4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
72902024-12-21T07:52:32.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 410008d5-7166-402e-b91f-4785e5b5b8f4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
72912024-12-21T07:52:32.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 410008d5-7166-402e-b91f-4785e5b5b8f4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
72922024-12-21T07:52:33.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2a448325-d443-4055-83eb-84514d7ffe0e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
72932024-12-21T07:52:33.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2a448325-d443-4055-83eb-84514d7ffe0e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
72942024-12-21T07:52:33.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1715 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2a448325-d443-4055-83eb-84514d7ffe0e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
72952024-12-21T07:52:34.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6ca28d02-6287-4f97-a0da-87fc18c0b57d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
72962024-12-21T07:52:34.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6ca28d02-6287-4f97-a0da-87fc18c0b57d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
72972024-12-21T07:52:34.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6ca28d02-6287-4f97-a0da-87fc18c0b57d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
72982024-12-21T07:52:34.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 5865c5a1-711c-4beb-9a9c-f6da7dbc6b27 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
72992024-12-21T07:52:34.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 5865c5a1-711c-4beb-9a9c-f6da7dbc6b27 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
73002024-12-21T07:52:34.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 5865c5a1-711c-4beb-9a9c-f6da7dbc6b27 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
73012024-12-21T07:52:34.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = e6f12f8f-6a66-4fa7-a68c-3e9752f5b521 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
73022024-12-21T07:52:34.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = e6f12f8f-6a66-4fa7-a68c-3e9752f5b521 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
73032024-12-21T07:52:34.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = e6f12f8f-6a66-4fa7-a68c-3e9752f5b521 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
73042024-12-21T07:52:35.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b100670b-cf36-4af1-ad78-59053d79a2ea roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73052024-12-21T07:52:35.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b100670b-cf36-4af1-ad78-59053d79a2ea resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73062024-12-21T07:52:35.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b100670b-cf36-4af1-ad78-59053d79a2ea response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73072024-12-21T07:52:36.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 768a1e35-42e9-4178-bec5-6b16553191da roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73082024-12-21T07:52:36.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 768a1e35-42e9-4178-bec5-6b16553191da resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73092024-12-21T07:52:36.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 768a1e35-42e9-4178-bec5-6b16553191da response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73102024-12-21T07:52:37.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8af0a78-96bc-4ca9-b528-778e80439459 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73112024-12-21T07:52:37.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8af0a78-96bc-4ca9-b528-778e80439459 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73122024-12-21T07:52:37.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8af0a78-96bc-4ca9-b528-778e80439459 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73132024-12-21T07:52:38.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c8f5867b-2eed-48a7-8515-4f70145a00a5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73142024-12-21T07:52:38.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c8f5867b-2eed-48a7-8515-4f70145a00a5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73152024-12-21T07:52:38.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c8f5867b-2eed-48a7-8515-4f70145a00a5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73162024-12-21T07:52:39.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 942c104f-a5d9-490e-9358-45fd0324d49e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73172024-12-21T07:52:39.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 942c104f-a5d9-490e-9358-45fd0324d49e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73182024-12-21T07:52:39.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 942c104f-a5d9-490e-9358-45fd0324d49e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73192024-12-21T07:52:39.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1416 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = e83c7780-786d-4438-aa54-44a3eb3d8a47 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
73202024-12-21T07:52:40.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c4d1116b-45c6-4f0e-9acb-41c05bec9d4b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73212024-12-21T07:52:40.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c4d1116b-45c6-4f0e-9acb-41c05bec9d4b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73222024-12-21T07:52:40.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c4d1116b-45c6-4f0e-9acb-41c05bec9d4b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73232024-12-21T07:52:40.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
73242024-12-21T07:52:40.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73252024-12-21T07:52:40.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
73262024-12-21T07:52:40.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73272024-12-21T07:52:40.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73282024-12-21T07:52:40.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73292024-12-21T07:52:40.668ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73302024-12-21T07:52:40.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73312024-12-21T07:52:40.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73322024-12-21T07:52:40.670ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.21343ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73332024-12-21T07:52:40.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73342024-12-21T07:52:40.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73352024-12-21T07:52:40.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73362024-12-21T07:52:40.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73372024-12-21T07:52:40.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73382024-12-21T07:52:40.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73392024-12-21T07:52:40.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
73402024-12-21T07:52:40.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73412024-12-21T07:52:40.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73422024-12-21T07:52:40.686ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
73432024-12-21T07:52:40.686ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.306398ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
73442024-12-21T07:52:41.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3e9e7e14-bf4b-412b-9ae6-c9c87cf03609 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73452024-12-21T07:52:41.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3e9e7e14-bf4b-412b-9ae6-c9c87cf03609 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73462024-12-21T07:52:41.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3e9e7e14-bf4b-412b-9ae6-c9c87cf03609 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73472024-12-21T07:52:42.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a2e3d30e-07e5-40cc-925f-aa160c626aee roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73482024-12-21T07:52:42.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a2e3d30e-07e5-40cc-925f-aa160c626aee resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73492024-12-21T07:52:42.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a2e3d30e-07e5-40cc-925f-aa160c626aee response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73502024-12-21T07:52:43.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 922f5571-bd7e-4cfe-aa00-f02f76f885bc roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73512024-12-21T07:52:43.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 922f5571-bd7e-4cfe-aa00-f02f76f885bc resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73522024-12-21T07:52:43.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 922f5571-bd7e-4cfe-aa00-f02f76f885bc response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73532024-12-21T07:52:44.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ccdf2808-85a2-4899-8d74-cdb3b4fc03aa roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73542024-12-21T07:52:44.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ccdf2808-85a2-4899-8d74-cdb3b4fc03aa resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73552024-12-21T07:52:44.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ccdf2808-85a2-4899-8d74-cdb3b4fc03aa response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73562024-12-21T07:52:45.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7a1f2d0-281e-4401-8a21-bb3495ba0f1e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73572024-12-21T07:52:45.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7a1f2d0-281e-4401-8a21-bb3495ba0f1e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73582024-12-21T07:52:45.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1625 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7a1f2d0-281e-4401-8a21-bb3495ba0f1e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73592024-12-21T07:52:46.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = da978a53-dbef-4828-b5d7-e5e69f21cd37 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73602024-12-21T07:52:46.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = da978a53-dbef-4828-b5d7-e5e69f21cd37 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73612024-12-21T07:52:46.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = da978a53-dbef-4828-b5d7-e5e69f21cd37 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73622024-12-21T07:52:47.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ce3dfd12-682d-42f4-8d2d-d4da89da84ac roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73632024-12-21T07:52:47.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ce3dfd12-682d-42f4-8d2d-d4da89da84ac resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73642024-12-21T07:52:47.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ce3dfd12-682d-42f4-8d2d-d4da89da84ac response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73652024-12-21T07:52:48.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ac2a07ac-39e2-4614-8182-c073b7c2548c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73662024-12-21T07:52:48.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ac2a07ac-39e2-4614-8182-c073b7c2548c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73672024-12-21T07:52:48.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ac2a07ac-39e2-4614-8182-c073b7c2548c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73682024-12-21T07:52:49.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 12514050-f8ef-47d3-9b1d-6eb960079d0e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73692024-12-21T07:52:49.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 12514050-f8ef-47d3-9b1d-6eb960079d0e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73702024-12-21T07:52:49.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 12514050-f8ef-47d3-9b1d-6eb960079d0e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73712024-12-21T07:52:49.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1296 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 2c380aa6-7624-437a-9e82-62566faa4e68 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
73722024-12-21T07:52:50.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
73732024-12-21T07:52:50.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
73742024-12-21T07:52:50.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73752024-12-21T07:52:50.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73762024-12-21T07:52:50.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73772024-12-21T07:52:50.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73782024-12-21T07:52:50.668ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73792024-12-21T07:52:50.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73802024-12-21T07:52:50.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73812024-12-21T07:52:50.670ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.58689ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73822024-12-21T07:52:50.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73832024-12-21T07:52:50.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73842024-12-21T07:52:50.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73852024-12-21T07:52:50.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73862024-12-21T07:52:50.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73872024-12-21T07:52:50.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73882024-12-21T07:52:50.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
73892024-12-21T07:52:50.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73902024-12-21T07:52:50.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73912024-12-21T07:52:50.685ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
73922024-12-21T07:52:50.685ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.451377ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
73932024-12-21T07:52:50.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 25220892-eb32-4b05-b2c9-49ffa78cc977 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73942024-12-21T07:52:50.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 25220892-eb32-4b05-b2c9-49ffa78cc977 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73952024-12-21T07:52:50.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1780 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 25220892-eb32-4b05-b2c9-49ffa78cc977 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73962024-12-21T07:52:51.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d13a718b-f454-4c21-bc71-d69f99266164 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73972024-12-21T07:52:51.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d13a718b-f454-4c21-bc71-d69f99266164 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73982024-12-21T07:52:51.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d13a718b-f454-4c21-bc71-d69f99266164 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
73992024-12-21T07:52:52.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cb5a1a96-165f-449a-ace8-09c0904c4af0 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74002024-12-21T07:52:52.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cb5a1a96-165f-449a-ace8-09c0904c4af0 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74012024-12-21T07:52:52.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cb5a1a96-165f-449a-ace8-09c0904c4af0 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74022024-12-21T07:52:53.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = be06e5d0-c4fe-4961-9180-10f999693ad4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74032024-12-21T07:52:53.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = be06e5d0-c4fe-4961-9180-10f999693ad4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74042024-12-21T07:52:53.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = be06e5d0-c4fe-4961-9180-10f999693ad4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74052024-12-21T07:52:54.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b4a75d7f-e227-4dfc-88b8-aeb6fc11cddb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74062024-12-21T07:52:54.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b4a75d7f-e227-4dfc-88b8-aeb6fc11cddb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74072024-12-21T07:52:54.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b4a75d7f-e227-4dfc-88b8-aeb6fc11cddb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74082024-12-21T07:52:55.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d4b58670-32f3-45ce-88cd-5f9175c5208e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74092024-12-21T07:52:55.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d4b58670-32f3-45ce-88cd-5f9175c5208e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74102024-12-21T07:52:55.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d4b58670-32f3-45ce-88cd-5f9175c5208e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74112024-12-21T07:52:56.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f68b10eb-653b-4dba-bf8f-26ebe6f5def2 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74122024-12-21T07:52:56.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f68b10eb-653b-4dba-bf8f-26ebe6f5def2 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74132024-12-21T07:52:56.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f68b10eb-653b-4dba-bf8f-26ebe6f5def2 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74142024-12-21T07:52:57.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7667666a-2455-4c2a-9e7a-ddafe0f2b2df roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74152024-12-21T07:52:57.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7667666a-2455-4c2a-9e7a-ddafe0f2b2df resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74162024-12-21T07:52:57.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7667666a-2455-4c2a-9e7a-ddafe0f2b2df response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74172024-12-21T07:52:58.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 33a91357-5edd-4a1b-af3e-92328521a39e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74182024-12-21T07:52:58.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 33a91357-5edd-4a1b-af3e-92328521a39e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74192024-12-21T07:52:58.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 33a91357-5edd-4a1b-af3e-92328521a39e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74202024-12-21T07:52:59.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1365 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 4ca22e38-c12c-4c06-960b-65e69141a2d1 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
74212024-12-21T07:52:59.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 43edf408-a3bd-4f55-8e33-99803715bdfa roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74222024-12-21T07:52:59.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 43edf408-a3bd-4f55-8e33-99803715bdfa resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74232024-12-21T07:52:59.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1751 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 43edf408-a3bd-4f55-8e33-99803715bdfa response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
74242024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
74252024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
74262024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74272024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
74282024-12-21T07:53:00.666ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
74292024-12-21T07:53:00.666ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
74302024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
74312024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74322024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
74332024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74342024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
74352024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
74362024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
74372024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74382024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
74392024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
74402024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
74412024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74422024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74432024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
74442024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74452024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
74462024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74472024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
74482024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
74492024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74502024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
74512024-12-21T07:53:00.666ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:43:00.666621591 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
74522024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
74532024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
74542024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74552024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
74562024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
74572024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
74582024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74592024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
74602024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
74612024-12-21T07:53:00.666ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b
74622024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
74632024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
74642024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.35\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b"}
74652024-12-21T07:53:00.666ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
74662024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
74672024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74682024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
74692024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
74702024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74712024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74722024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
74732024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
74742024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
74752024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74762024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
74772024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
74782024-12-21T07:53:00.666ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
74792024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
74802024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74812024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74822024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
74832024-12-21T07:53:00.666ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
74842024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
74852024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
74862024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
74872024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
74882024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
74892024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
74902024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
74912024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
74922024-12-21T07:53:00.667ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
74932024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
74942024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74952024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74962024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74972024-12-21T07:53:00.667ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
74982024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74992024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75002024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
75012024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75022024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75032024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75042024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75052024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
75062024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
75072024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75082024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75092024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75102024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
75112024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75122024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75132024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75142024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
75152024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75162024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
75172024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
75182024-12-21T07:53:00.667ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dd95bbd-e009-486c-8c96-451a6e195a49.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1514, tv_nsec: 366583909 } })
75192024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75202024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75212024-12-21T07:53:00.667ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bfae345-1659-4377-bca9-c55abec2aeb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7c426166-4f75-4a87-b9ac-c0d590aea49b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1514, tv_nsec: 366613950 } })
75222024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
75232024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
75242024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.313602ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
75252024-12-21T07:53:00.667ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
75262024-12-21T07:53:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.293431ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
75272024-12-21T07:53:00.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75282024-12-21T07:53:00.669ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75292024-12-21T07:53:00.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75302024-12-21T07:53:00.670ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.917775ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75312024-12-21T07:53:00.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
75322024-12-21T07:53:00.671ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75332024-12-21T07:53:00.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75342024-12-21T07:53:00.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
75352024-12-21T07:53:00.672ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75362024-12-21T07:53:00.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75372024-12-21T07:53:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75382024-12-21T07:53:00.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75392024-12-21T07:53:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75402024-12-21T07:53:00.673ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1514, tv_nsec: 373163039 } })
75412024-12-21T07:53:00.674ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
75422024-12-21T07:53:00.674ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75432024-12-21T07:53:00.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75442024-12-21T07:53:00.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75452024-12-21T07:53:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75462024-12-21T07:53:00.677ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:43:00.666621591 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
75472024-12-21T07:53:00.677ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.394673ms iteration = 11 status = {"expiration":"2024-12-21T07:43:00.666621591Z","pruned":[]}
75482024-12-21T07:53:00.677ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75492024-12-21T07:53:00.677ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75502024-12-21T07:53:00.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75512024-12-21T07:53:00.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75522024-12-21T07:53:00.679ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75532024-12-21T07:53:00.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75542024-12-21T07:53:00.684ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1514, tv_nsec: 383636803 } })
75552024-12-21T07:53:00.684ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
75562024-12-21T07:53:00.685ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75572024-12-21T07:53:00.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75582024-12-21T07:53:00.692ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75592024-12-21T07:53:00.692ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.532145ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
75602024-12-21T07:53:00.694ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
75612024-12-21T07:53:00.695ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75622024-12-21T07:53:00.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75632024-12-21T07:53:00.698ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75642024-12-21T07:53:00.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75652024-12-21T07:53:00.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75662024-12-21T07:53:00.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75672024-12-21T07:53:00.717ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75682024-12-21T07:53:00.718ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
75692024-12-21T07:53:00.718ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 078214b6-af09-460a-89be-e20df807f0ce
75702024-12-21T07:53:00.718ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = e12a55fa-cbb1-48b0-9b03-cc8da6da6576
75712024-12-21T07:53:00.718ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = d3d0b31f-d719-4f92-8c8d-59bd1dc08a45
75722024-12-21T07:53:00.718ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 078214b6-af09-460a-89be-e20df807f0ce
75732024-12-21T07:53:00.718ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = d3d0b31f-d719-4f92-8c8d-59bd1dc08a45
75742024-12-21T07:53:00.718ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = e12a55fa-cbb1-48b0-9b03-cc8da6da6576
75752024-12-21T07:53:00.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75762024-12-21T07:53:00.719ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75772024-12-21T07:53:00.719ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75782024-12-21T07:53:00.719ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75792024-12-21T07:53:00.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75802024-12-21T07:53:00.720ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.950868ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
75812024-12-21T07:53:00.722ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
75822024-12-21T07:53:00.722ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
75832024-12-21T07:53:00.722ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 55.646175ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
75842024-12-21T07:53:00.722ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 56.398258ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
75852024-12-21T07:53:00.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75862024-12-21T07:53:00.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75872024-12-21T07:53:00.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75882024-12-21T07:53:00.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75892024-12-21T07:53:00.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75902024-12-21T07:53:00.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75912024-12-21T07:53:00.727ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75922024-12-21T07:53:00.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75932024-12-21T07:53:00.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75942024-12-21T07:53:00.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75952024-12-21T07:53:00.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75962024-12-21T07:53:00.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
75972024-12-21T07:53:00.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.982645ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75982024-12-21T07:53:00.731ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75992024-12-21T07:53:00.731ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76002024-12-21T07:53:00.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76012024-12-21T07:53:00.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76022024-12-21T07:53:00.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76032024-12-21T07:53:00.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76042024-12-21T07:53:00.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76052024-12-21T07:53:00.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
76062024-12-21T07:53:00.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76072024-12-21T07:53:00.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76082024-12-21T07:53:00.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76092024-12-21T07:53:00.738ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
76102024-12-21T07:53:00.738ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76112024-12-21T07:53:00.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76122024-12-21T07:53:00.739ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76132024-12-21T07:53:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76142024-12-21T07:53:00.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76152024-12-21T07:53:00.739ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
76162024-12-21T07:53:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76172024-12-21T07:53:00.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76182024-12-21T07:53:00.742ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76192024-12-21T07:53:00.742ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
76202024-12-21T07:53:00.742ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
76212024-12-21T07:53:00.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
76222024-12-21T07:53:00.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 77.240655ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
76232024-12-21T07:53:00.744ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76242024-12-21T07:53:00.744ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76252024-12-21T07:53:00.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76262024-12-21T07:53:00.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
76272024-12-21T07:53:00.745ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
76282024-12-21T07:53:00.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76292024-12-21T07:53:00.747ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76302024-12-21T07:53:00.748ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76312024-12-21T07:53:00.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76322024-12-21T07:53:00.748ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76332024-12-21T07:53:00.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76342024-12-21T07:53:00.749ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76352024-12-21T07:53:00.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76362024-12-21T07:53:00.751ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76372024-12-21T07:53:00.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76382024-12-21T07:53:00.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
76392024-12-21T07:53:00.752ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76402024-12-21T07:53:00.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76412024-12-21T07:53:00.754ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
76422024-12-21T07:53:00.754ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.846381ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
76432024-12-21T07:53:00.755ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1514, tv_nsec: 454863338 } })
76442024-12-21T07:53:00.756ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
76452024-12-21T07:53:00.756ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76462024-12-21T07:53:00.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76472024-12-21T07:53:00.757ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(6b4ef600-7b30-49d7-8b7f-3d00edc300ce, 0), (f9cd3d0f-7f47-45cc-aa83-b4804b23d4be, 0), (c151690e-8ec4-49a7-ba09-bf7a35ca475a, 0), (c90ca866-02a5-446b-8b8e-df8d35b6ec36, 0)] collection_id = 6b4ef600-7b30-49d7-8b7f-3d00edc300ce
76482024-12-21T07:53:00.757ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
76492024-12-21T07:53:00.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
76502024-12-21T07:53:00.758ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76512024-12-21T07:53:00.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76522024-12-21T07:53:00.759ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
76532024-12-21T07:53:00.759ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.063228ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
76542024-12-21T07:53:00.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76552024-12-21T07:53:00.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76562024-12-21T07:53:00.761ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.176644ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76572024-12-21T07:53:00.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76582024-12-21T07:53:00.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76592024-12-21T07:53:00.764ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 98.046972ms iteration = 24 status = {"physical_disks_added":0}
76602024-12-21T07:53:00.765ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76612024-12-21T07:53:00.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
76622024-12-21T07:53:00.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
76632024-12-21T07:53:00.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
76642024-12-21T07:53:00.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76652024-12-21T07:53:00.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76662024-12-21T07:53:00.769ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
76672024-12-21T07:53:00.769ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 102.384333ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
76682024-12-21T07:53:00.770ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.859488ms iteration = 21 status = 0
76692024-12-21T07:53:00.770ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
76702024-12-21T07:53:00.770ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76712024-12-21T07:53:00.771ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d5372c6-642b-4d37-950d-c44ce5622794", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
76722024-12-21T07:53:00.771ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76732024-12-21T07:53:00.771ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
76742024-12-21T07:53:00.771ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
76752024-12-21T07:53:00.771ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
76762024-12-21T07:53:00.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76772024-12-21T07:53:00.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76782024-12-21T07:53:00.772ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76792024-12-21T07:53:00.773ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76802024-12-21T07:53:00.775ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
76812024-12-21T07:53:00.775ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
76822024-12-21T07:53:00.775ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
76832024-12-21T07:53:00.775ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76842024-12-21T07:53:00.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76852024-12-21T07:53:00.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76862024-12-21T07:53:00.776ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76872024-12-21T07:53:00.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76882024-12-21T07:53:00.777ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76892024-12-21T07:53:00.780ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76902024-12-21T07:53:00.780ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76912024-12-21T07:53:00.780ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76922024-12-21T07:53:00.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76932024-12-21T07:53:00.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76942024-12-21T07:53:00.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76952024-12-21T07:53:00.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76962024-12-21T07:53:00.784ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 118.316118ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76972024-12-21T07:53:00.784ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
76982024-12-21T07:53:00.785ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
76992024-12-21T07:53:00.786ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77002024-12-21T07:53:00.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77012024-12-21T07:53:00.792ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77022024-12-21T07:53:00.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77032024-12-21T07:53:00.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 5ee94bf1-e3b2-4bb7-b155-7ab9d787c00e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
77042024-12-21T07:53:00.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 5ee94bf1-e3b2-4bb7-b155-7ab9d787c00e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
77052024-12-21T07:53:00.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4945 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 5ee94bf1-e3b2-4bb7-b155-7ab9d787c00e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
77062024-12-21T07:53:00.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77072024-12-21T07:53:00.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77082024-12-21T07:53:00.803ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
77092024-12-21T07:53:00.803ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77102024-12-21T07:53:00.803ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
77112024-12-21T07:53:00.803ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
77122024-12-21T07:53:00.803ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 136.667444ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
77132024-12-21T07:53:00.803ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77142024-12-21T07:53:00.803ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "92bb107c-57e7-46a3-8db2-b355a9d6a9f3", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
77152024-12-21T07:53:00.803ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77162024-12-21T07:53:00.805ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
77172024-12-21T07:53:00.805ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77182024-12-21T07:53:00.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77192024-12-21T07:53:00.805ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77202024-12-21T07:53:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77212024-12-21T07:53:00.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77222024-12-21T07:53:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77232024-12-21T07:53:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
77242024-12-21T07:53:00.809ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77252024-12-21T07:53:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77262024-12-21T07:53:00.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 143.231723ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
77272024-12-21T07:53:00.812ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77282024-12-21T07:53:00.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77292024-12-21T07:53:00.813ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
77302024-12-21T07:53:00.813ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 6b4ef600-7b30-49d7-8b7f-3d00edc300ce file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
77312024-12-21T07:53:00.813ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
77322024-12-21T07:53:00.813ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
77332024-12-21T07:53:00.813ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:43:39.444085 UTC dns_group = internal generation = 1
77342024-12-21T07:53:00.813ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 146.603029ms iteration = 12 status = {"generation":1}
77352024-12-21T07:53:00.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
77362024-12-21T07:53:00.815ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77372024-12-21T07:53:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77382024-12-21T07:53:00.824ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:42:50.264108Z, time_modified: 2024-12-21T07:42:50.264108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }) }
77392024-12-21T07:53:00.824ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 157.359389ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]}},"default_endpoint":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
77402024-12-21T07:53:00.830ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77412024-12-21T07:53:00.834ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
77422024-12-21T07:53:00.834ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 0 version = 2
77432024-12-21T07:53:00.834ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77442024-12-21T07:53:00.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77452024-12-21T07:53:00.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
77462024-12-21T07:53:00.836ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77472024-12-21T07:53:00.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77482024-12-21T07:53:00.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77492024-12-21T07:53:00.838ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(f9cd3d0f-7f47-45cc-aa83-b4804b23d4be, 0), (c151690e-8ec4-49a7-ba09-bf7a35ca475a, 0), (c90ca866-02a5-446b-8b8e-df8d35b6ec36, 0)]
77502024-12-21T07:53:00.838ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77512024-12-21T07:53:00.838ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77522024-12-21T07:53:00.838ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 172.037653ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
77532024-12-21T07:53:00.838ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1514, tv_nsec: 538122664 } })
77542024-12-21T07:53:00.839ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77552024-12-21T07:53:00.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77562024-12-21T07:53:00.845ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77572024-12-21T07:53:00.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77582024-12-21T07:53:00.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77592024-12-21T07:53:00.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77602024-12-21T07:53:00.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77612024-12-21T07:53:00.847ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77622024-12-21T07:53:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77632024-12-21T07:53:00.848ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 1 version = 2
77642024-12-21T07:53:00.848ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
77652024-12-21T07:53:00.848ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:43:41.075205 UTC dns_group = external generation = 2
77662024-12-21T07:53:00.848ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 182.10437ms iteration = 12 status = {"generation":2}
77672024-12-21T07:53:00.850ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77682024-12-21T07:53:00.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77692024-12-21T07:53:00.852ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77702024-12-21T07:53:00.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77712024-12-21T07:53:00.854ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77722024-12-21T07:53:00.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77732024-12-21T07:53:00.859ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77742024-12-21T07:53:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
77752024-12-21T07:53:00.864ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77762024-12-21T07:53:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77772024-12-21T07:53:00.866ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77782024-12-21T07:53:00.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77792024-12-21T07:53:00.868ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77802024-12-21T07:53:00.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77812024-12-21T07:53:00.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77822024-12-21T07:53:00.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77832024-12-21T07:53:00.874ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77842024-12-21T07:53:00.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77852024-12-21T07:53:00.876ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77862024-12-21T07:53:00.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77872024-12-21T07:53:00.877ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77882024-12-21T07:53:00.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77892024-12-21T07:53:00.879ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77902024-12-21T07:53:00.890ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
77912024-12-21T07:53:00.890ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77922024-12-21T07:53:00.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77932024-12-21T07:53:00.896ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77942024-12-21T07:53:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77952024-12-21T07:53:00.899ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77962024-12-21T07:53:00.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77972024-12-21T07:53:00.901ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77982024-12-21T07:53:00.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
77992024-12-21T07:53:00.906ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78002024-12-21T07:53:00.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78012024-12-21T07:53:00.913ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78022024-12-21T07:53:00.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78032024-12-21T07:53:00.914ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78042024-12-21T07:53:00.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78052024-12-21T07:53:00.915ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
78062024-12-21T07:53:00.915ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78072024-12-21T07:53:00.917ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78082024-12-21T07:53:00.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78092024-12-21T07:53:00.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78102024-12-21T07:53:00.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78112024-12-21T07:53:00.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78122024-12-21T07:53:00.919ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78132024-12-21T07:53:00.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78142024-12-21T07:53:00.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78152024-12-21T07:53:00.922ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78162024-12-21T07:53:00.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78172024-12-21T07:53:00.923ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78182024-12-21T07:53:00.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78192024-12-21T07:53:00.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78202024-12-21T07:53:00.925ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78212024-12-21T07:53:00.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78222024-12-21T07:53:00.927ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78232024-12-21T07:53:00.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78242024-12-21T07:53:00.929ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78252024-12-21T07:53:00.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78262024-12-21T07:53:00.930ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78272024-12-21T07:53:00.933ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
78282024-12-21T07:53:00.933ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d9f8ac3d-7771-436a-bdc6-99264eb09bcb", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78292024-12-21T07:53:00.933ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78302024-12-21T07:53:00.935ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
78312024-12-21T07:53:00.936ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78322024-12-21T07:53:00.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78332024-12-21T07:53:00.936ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8107a44f-5237-47a1-9ccc-10b25796e031", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78342024-12-21T07:53:00.936ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78352024-12-21T07:53:00.937ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78362024-12-21T07:53:00.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78372024-12-21T07:53:00.938ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78382024-12-21T07:53:00.938ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 271.868003ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
78392024-12-21T07:53:00.949ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
78402024-12-21T07:53:00.949ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78412024-12-21T07:53:00.949ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d484795-0a84-47b8-86a3-44c4c04fd081", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78422024-12-21T07:53:00.949ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78432024-12-21T07:53:00.951ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
78442024-12-21T07:53:00.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e1e30c72-8b12-44a5-847f-e45e4eaa96a8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
78452024-12-21T07:53:00.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e1e30c72-8b12-44a5-847f-e45e4eaa96a8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
78462024-12-21T07:53:00.968ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
78472024-12-21T07:53:00.969ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cda4c51-e732-49e8-ba14-fe571f27f0fe", "content-length": "1", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78482024-12-21T07:53:00.971ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78492024-12-21T07:53:00.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78502024-12-21T07:53:01.002ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
78512024-12-21T07:53:01.002ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78522024-12-21T07:53:01.003ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "89f89460-7530-4fef-89de-341cf4feeebd", "content-length": "372", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78532024-12-21T07:53:01.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78542024-12-21T07:53:01.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78552024-12-21T07:53:01.014ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 347.229487ms iteration = 21 status = {}
78562024-12-21T07:53:01.018ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
78572024-12-21T07:53:01.018ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
78582024-12-21T07:53:01.018ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
78592024-12-21T07:53:01.018ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "a12f7fe2-4c0c-45a0-a112-aae27e34ac30", "content-length": "476", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78602024-12-21T07:53:01.018ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
78612024-12-21T07:53:01.018ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a9cb928-fe62-4442-9daa-2d401a7da9f1", "content-length": "734", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78622024-12-21T07:53:01.019ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
78632024-12-21T07:53:01.019ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dc1df4d-77aa-499e-8693-f318da7e37a9", "content-length": "111", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78642024-12-21T07:53:01.019ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
78652024-12-21T07:53:01.019ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1e5ff46-11ed-4d91-981c-02444401a549", "content-length": "111", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78662024-12-21T07:53:01.019ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
78672024-12-21T07:53:01.020ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad5007b8-411a-4641-b959-d765485919e5", "content-length": "167", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78682024-12-21T07:53:01.020ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
78692024-12-21T07:53:01.020ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c76547f-7d4c-41cd-9fc9-65cf036a1808", "content-length": "167", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78702024-12-21T07:53:01.020ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
78712024-12-21T07:53:01.020ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bc4cb18-ccc2-4995-8e9b-3b52437a1fb3", "content-length": "175", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78722024-12-21T07:53:01.020ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
78732024-12-21T07:53:01.021ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8dbefa80-f780-4114-a8c1-7236b9ee6f02", "content-length": "175", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78742024-12-21T07:53:01.021ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
78752024-12-21T07:53:01.021ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a31f3b9b-c403-4df8-9086-1ad2dc088bdc", "content-length": "702", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78762024-12-21T07:53:01.021ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
78772024-12-21T07:53:01.021ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0705d1b0-85b5-4523-890c-14f214428089", "content-length": "727", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78782024-12-21T07:53:01.021ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
78792024-12-21T07:53:01.021ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c8b165b-c65f-4d9a-aba3-5a9308cf10b0", "content-length": "729", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78802024-12-21T07:53:01.021ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
78812024-12-21T07:53:01.021ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "43377a9a-2b3d-466f-a90f-22f606f4d108", "content-length": "728", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78822024-12-21T07:53:01.021ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
78832024-12-21T07:53:01.021ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a25294ff-e078-4477-9056-75444a6aa85a", "content-length": "722", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78842024-12-21T07:53:01.021ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
78852024-12-21T07:53:01.022ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0ba490f-bb3c-464c-80c8-889746528470", "content-length": "109", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78862024-12-21T07:53:01.022ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
78872024-12-21T07:53:01.022ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1024d304-7baf-4a3f-ba70-54a70e4bb37d", "content-length": "109", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78882024-12-21T07:53:01.022ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
78892024-12-21T07:53:01.022ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c40fdb4c-727e-4042-bc60-f9a9e558a39f", "content-length": "169", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78902024-12-21T07:53:01.022ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
78912024-12-21T07:53:01.023ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "15ac0f1a-9408-4b9f-bf3f-08f3d20f43d6", "content-length": "169", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78922024-12-21T07:53:01.023ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
78932024-12-21T07:53:01.023ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8666ed86-16d7-4f5e-a545-c81e64fb82b1", "content-length": "178", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78942024-12-21T07:53:01.023ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
78952024-12-21T07:53:01.023ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "93b4e54f-d696-44f5-ba41-a3f764411a4f", "content-length": "178", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78962024-12-21T07:53:01.023ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
78972024-12-21T07:53:01.023ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca05e318-dad8-4647-85f8-9ed2393fd82d", "content-length": "702", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
78982024-12-21T07:53:01.023ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
78992024-12-21T07:53:01.023ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7616f6ce-855a-43c5-bc53-a3128c4638e4", "content-length": "727", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
79002024-12-21T07:53:01.023ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
79012024-12-21T07:53:01.024ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2b91ebf-7e1a-4629-ac75-5c76764352f8", "content-length": "729", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
79022024-12-21T07:53:01.024ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
79032024-12-21T07:53:01.024ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6446d189-f720-4df6-8d60-1a8b818db167", "content-length": "728", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
79042024-12-21T07:53:01.024ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
79052024-12-21T07:53:01.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
79062024-12-21T07:53:01.039ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
79072024-12-21T07:53:01.039ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ae0ca9ee-ca9a-47ef-8eac-60126826a11b", "date": "Sat, 21 Dec 2024 07:53:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79082024-12-21T07:53:01.039ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79092024-12-21T07:53:01.040ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
79102024-12-21T07:53:01.040ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6e5ec332-5020-447b-b7dd-ba64f7287875", "date": "Sat, 21 Dec 2024 07:53:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79112024-12-21T07:53:01.040ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79122024-12-21T07:53:01.041ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "07afa8d7-2143-4a98-9039-d49de3784e4b", "content-length": "691", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
79132024-12-21T07:53:01.041ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
79142024-12-21T07:53:01.041ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
79152024-12-21T07:53:01.041ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
79162024-12-21T07:53:01.042ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79172024-12-21T07:53:01.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79182024-12-21T07:53:01.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e1e30c72-8b12-44a5-847f-e45e4eaa96a8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
79192024-12-21T07:53:01.042ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f7d9ed1d-95e8-4f62-97e3-daea855980db", "date": "Sat, 21 Dec 2024 07:53:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79202024-12-21T07:53:01.042ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79212024-12-21T07:53:01.043ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79222024-12-21T07:53:01.043ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 377.042344ms iteration = 21 status = null
79232024-12-21T07:53:01.044ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 377.261217ms iteration = 21 status = {}
79242024-12-21T07:53:01.044ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79252024-12-21T07:53:01.045ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
79262024-12-21T07:53:01.045ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 378.317074ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
79272024-12-21T07:53:01.045ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
79282024-12-21T07:53:01.045ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
79292024-12-21T07:53:01.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
79302024-12-21T07:53:01.047ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79312024-12-21T07:53:01.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
79322024-12-21T07:53:01.048ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79332024-12-21T07:53:01.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79342024-12-21T07:53:01.050ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
79352024-12-21T07:53:01.050ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
79362024-12-21T07:53:01.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
79372024-12-21T07:53:01.056ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 1590b051-5b52-401c-b768-bbef4af00f89, kind: Service { id: bf6abf36-caab-412a-b734-038cee4a46b6 }, name: Name("nexus-bf6abf36-caab-412a-b734-038cee4a46b6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2a0ff22a-6a78-4cb0-b61d-38c999331844, kind: Service { id: e640ec59-1392-402a-8715-71c8bdc91537 }, name: Name("nexus-e640ec59-1392-402a-8715-71c8bdc91537"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 32])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd0592d1-5774-4ea2-8826-dec211cc7fec, kind: Service { id: a920b126-b55b-45c8-9984-5279bf662759 }, name: Name("nexus-a920b126-b55b-45c8-9984-5279bf662759"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 06368864-4b29-42bd-ae60-c6735712620d, kind: Service { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 }, name: Name("external-dns-b2ae004a-4c01-4dcf-8e90-49ba61c66084"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa85cda4-dfd2-46dc-aa66-9384e585dcaf, kind: Service { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 }, name: Name("external-dns-4dd95bbd-e009-486c-8c96-451a6e195a49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
79382024-12-21T07:53:01.056ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79392024-12-21T07:53:01.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79402024-12-21T07:53:01.058ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79412024-12-21T07:53:01.060ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
79422024-12-21T07:53:01.060ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79432024-12-21T07:53:01.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79442024-12-21T07:53:01.062ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
79452024-12-21T07:53:01.062ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 06368864-4b29-42bd-ae60-c6735712620d, kind: Service { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 }, name: Name("external-dns-b2ae004a-4c01-4dcf-8e90-49ba61c66084"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa85cda4-dfd2-46dc-aa66-9384e585dcaf, kind: Service { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 }, name: Name("external-dns-4dd95bbd-e009-486c-8c96-451a6e195a49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1590b051-5b52-401c-b768-bbef4af00f89, kind: Service { id: bf6abf36-caab-412a-b734-038cee4a46b6 }, name: Name("nexus-bf6abf36-caab-412a-b734-038cee4a46b6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2a0ff22a-6a78-4cb0-b61d-38c999331844, kind: Service { id: e640ec59-1392-402a-8715-71c8bdc91537 }, name: Name("nexus-e640ec59-1392-402a-8715-71c8bdc91537"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 32])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd0592d1-5774-4ea2-8826-dec211cc7fec, kind: Service { id: a920b126-b55b-45c8-9984-5279bf662759 }, name: Name("nexus-a920b126-b55b-45c8-9984-5279bf662759"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
79462024-12-21T07:53:01.062ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
79472024-12-21T07:53:01.095ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
79482024-12-21T07:53:01.095ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
79492024-12-21T07:53:01.096ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "863aa204-f46e-4e1b-b275-8d7a7ad6604b", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
79502024-12-21T07:53:01.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79512024-12-21T07:53:01.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79522024-12-21T07:53:01.126ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
79532024-12-21T07:53:01.126ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
79542024-12-21T07:53:01.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79552024-12-21T07:53:01.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79562024-12-21T07:53:01.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79572024-12-21T07:53:01.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79582024-12-21T07:53:01.135ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
79592024-12-21T07:53:01.135ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79602024-12-21T07:53:01.136ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "778d56cb-d489-4ca8-8187-c6ae037dc580", "date": "Sat, 21 Dec 2024 07:53:01 GMT"} })
79612024-12-21T07:53:01.137ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 470.896075ms iteration = 22 status = {}
79622024-12-21T07:53:01.146ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79632024-12-21T07:53:01.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79642024-12-21T07:53:01.149ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
79652024-12-21T07:53:01.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79662024-12-21T07:53:01.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79672024-12-21T07:53:01.159ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
79682024-12-21T07:53:01.159ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b569f6e9-7b9d-4898-926e-81719758d0ab", "content-length": "134", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
79692024-12-21T07:53:01.159ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
79702024-12-21T07:53:01.159ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
79712024-12-21T07:53:01.159ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
79722024-12-21T07:53:01.159ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
79732024-12-21T07:53:01.159ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79742024-12-21T07:53:01.159ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79752024-12-21T07:53:01.159ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79762024-12-21T07:53:01.159ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79772024-12-21T07:53:01.159ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79782024-12-21T07:53:01.159ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79792024-12-21T07:53:01.160ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
79802024-12-21T07:53:01.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79812024-12-21T07:53:01.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79822024-12-21T07:53:01.162ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
79832024-12-21T07:53:01.162ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c63bf95e-ce1e-481a-891a-f809873f60e0", "content-length": "2", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
79842024-12-21T07:53:01.162ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
79852024-12-21T07:53:01.162ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ea1fd1b-5b59-47e4-b4bd-0234e39b7283", "content-length": "52", "date": "Sat, 21 Dec 2024 07:53:00 GMT"} })
79862024-12-21T07:53:01.162ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
79872024-12-21T07:53:01.162ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
79882024-12-21T07:53:01.185ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, time_created: 2024-12-21T07:43:34.995625Z, time_modified: 2024-12-21T07:43:34.995625Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
79892024-12-21T07:53:01.185ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
79902024-12-21T07:53:01.185ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79912024-12-21T07:53:01.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79922024-12-21T07:53:01.188ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
79932024-12-21T07:53:01.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
79942024-12-21T07:53:01.190ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79952024-12-21T07:53:01.193ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
79962024-12-21T07:53:01.223ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
79972024-12-21T07:53:01.225ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "3a4febc0-543e-4af0-af3d-5dcde0135643", "date": "Sat, 21 Dec 2024 07:53:01 GMT"} })
79982024-12-21T07:53:01.226ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
79992024-12-21T07:53:01.226ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 560.14576ms
80002024-12-21T07:53:01.226ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 560.15554ms iteration = 3 status = {}
80012024-12-21T07:53:01.269ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "52a17797-8fe8-4f9b-b341-84e1a7bd0798", "date": "Sat, 21 Dec 2024 07:53:01 GMT"} })
80022024-12-21T07:53:01.269ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
80032024-12-21T07:53:01.269ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
80042024-12-21T07:53:01.269ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ad8b5e7-6fc5-4b8e-aeec-a64af95ec003", "content-length": "682", "date": "Sat, 21 Dec 2024 07:53:01 GMT"} })
80052024-12-21T07:53:01.269ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80062024-12-21T07:53:01.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80072024-12-21T07:53:01.274ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80082024-12-21T07:53:01.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80092024-12-21T07:53:01.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80102024-12-21T07:53:01.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80112024-12-21T07:53:01.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80122024-12-21T07:53:01.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80132024-12-21T07:53:01.289ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 622.896454ms iteration = 21 status = {}
80142024-12-21T07:53:01.350ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "4978aa15-cd91-4f99-8373-b0b1893d2247", "content-length": "30799", "date": "Sat, 21 Dec 2024 07:53:01 GMT"} })
80152024-12-21T07:53:01.352ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
80162024-12-21T07:53:01.352ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
80172024-12-21T07:53:01.352ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
80182024-12-21T07:53:01.354ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80192024-12-21T07:53:01.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80202024-12-21T07:53:01.356ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80212024-12-21T07:53:01.358ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
80222024-12-21T07:53:01.358ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80232024-12-21T07:53:01.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80242024-12-21T07:53:01.517ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 0a73adc0-f19c-4b26-9ef3-efe4abaaaaa7 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
80252024-12-21T07:53:01.518ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 0a73adc0-f19c-4b26-9ef3-efe4abaaaaa7 time_started = 2024-12-21 07:53:01.018274 UTC
80262024-12-21T07:53:01.518ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 851.197583ms iteration = 4 status = {"collection_id":"0a73adc0-f19c-4b26-9ef3-efe4abaaaaa7","time_done":"2024-12-21 07:53:01.352579 UTC","time_started":"2024-12-21 07:53:01.018274 UTC"}
80272024-12-21T07:53:01.518ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
80282024-12-21T07:53:01.518ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80292024-12-21T07:53:01.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80302024-12-21T07:53:01.520ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80312024-12-21T07:53:01.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80322024-12-21T07:53:01.522ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80332024-12-21T07:53:01.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80342024-12-21T07:53:01.523ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80352024-12-21T07:53:01.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80362024-12-21T07:53:01.526ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80372024-12-21T07:53:01.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80382024-12-21T07:53:01.528ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80392024-12-21T07:53:01.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80402024-12-21T07:53:01.565ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 47.888506ms iteration = 25 status = {"physical_disks_added":0}
80412024-12-21T07:53:02.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8dbc70d9-e394-421e-b4c3-9e528e18adf5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80422024-12-21T07:53:02.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8dbc70d9-e394-421e-b4c3-9e528e18adf5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80432024-12-21T07:53:02.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8dbc70d9-e394-421e-b4c3-9e528e18adf5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80442024-12-21T07:53:03.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8a115ef8-de6e-47cb-aadd-5b667aa06549 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80452024-12-21T07:53:03.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8a115ef8-de6e-47cb-aadd-5b667aa06549 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80462024-12-21T07:53:03.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2711 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8a115ef8-de6e-47cb-aadd-5b667aa06549 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80472024-12-21T07:53:04.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eaf26de8-4ff9-41ac-98c9-6d1528fb81e4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80482024-12-21T07:53:04.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eaf26de8-4ff9-41ac-98c9-6d1528fb81e4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80492024-12-21T07:53:04.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eaf26de8-4ff9-41ac-98c9-6d1528fb81e4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80502024-12-21T07:53:05.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3479ea5e-d5f4-49c9-8a38-fe5211429378 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80512024-12-21T07:53:05.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3479ea5e-d5f4-49c9-8a38-fe5211429378 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80522024-12-21T07:53:05.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2561 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3479ea5e-d5f4-49c9-8a38-fe5211429378 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80532024-12-21T07:53:05.188ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45113
80542024-12-21T07:53:05.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45113 req_id = d2b35ca4-16fb-45c9-8c81-d0466f9a3243 roles = RoleSet { roles: {} } uri = /metrics/producers
80552024-12-21T07:53:05.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45113 req_id = d2b35ca4-16fb-45c9-8c81-d0466f9a3243 resource = Database result = Ok(()) uri = /metrics/producers
80562024-12-21T07:53:05.233ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = e2e45dd6-1479-4aab-8030-3bcab95a4f4b
80572024-12-21T07:53:05.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44386 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45113 req_id = d2b35ca4-16fb-45c9-8c81-d0466f9a3243 response_code = 201 uri = /metrics/producers
80582024-12-21T07:53:06.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 45c48c1e-2bac-4130-8db3-7822ff5db0b9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80592024-12-21T07:53:06.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 45c48c1e-2bac-4130-8db3-7822ff5db0b9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80602024-12-21T07:53:06.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 45c48c1e-2bac-4130-8db3-7822ff5db0b9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80612024-12-21T07:53:07.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = af7f2838-af88-46fc-8966-12f590ad5729 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80622024-12-21T07:53:07.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = af7f2838-af88-46fc-8966-12f590ad5729 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80632024-12-21T07:53:07.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = af7f2838-af88-46fc-8966-12f590ad5729 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80642024-12-21T07:53:07.247ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:33824
80652024-12-21T07:53:07.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33824 req_id = fd41c597-e5a2-4ddd-85f8-c42df3565ec0 roles = RoleSet { roles: {} } uri = /metrics/producers
80662024-12-21T07:53:07.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33824 req_id = fd41c597-e5a2-4ddd-85f8-c42df3565ec0 resource = Database result = Ok(()) uri = /metrics/producers
80672024-12-21T07:53:07.289ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 5032d219-f3bf-40f5-8e36-efba904d39be
80682024-12-21T07:53:07.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41671 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33824 req_id = fd41c597-e5a2-4ddd-85f8-c42df3565ec0 response_code = 201 uri = /metrics/producers
80692024-12-21T07:53:08.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2f80e4fd-b973-4d56-bc8e-35fb88338827 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80702024-12-21T07:53:08.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2f80e4fd-b973-4d56-bc8e-35fb88338827 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80712024-12-21T07:53:08.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2f80e4fd-b973-4d56-bc8e-35fb88338827 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80722024-12-21T07:53:09.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b5c56b71-1072-4072-a6cd-d3bd54be07c7 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80732024-12-21T07:53:09.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b5c56b71-1072-4072-a6cd-d3bd54be07c7 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80742024-12-21T07:53:09.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b5c56b71-1072-4072-a6cd-d3bd54be07c7 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80752024-12-21T07:53:09.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1301 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = fa6503c1-23c6-46a0-bd00-ea015129c31e response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
80762024-12-21T07:53:10.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 62c239b7-7d20-41d5-966f-6fcd0ce1f3ba roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80772024-12-21T07:53:10.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 62c239b7-7d20-41d5-966f-6fcd0ce1f3ba resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80782024-12-21T07:53:10.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 62c239b7-7d20-41d5-966f-6fcd0ce1f3ba response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
80792024-12-21T07:53:10.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
80802024-12-21T07:53:10.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
80812024-12-21T07:53:10.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80822024-12-21T07:53:10.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80832024-12-21T07:53:10.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80842024-12-21T07:53:10.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80852024-12-21T07:53:10.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80862024-12-21T07:53:10.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80872024-12-21T07:53:10.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80882024-12-21T07:53:10.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80892024-12-21T07:53:10.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80902024-12-21T07:53:10.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80912024-12-21T07:53:10.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80922024-12-21T07:53:10.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
80932024-12-21T07:53:10.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80942024-12-21T07:53:10.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80952024-12-21T07:53:10.688ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
80962024-12-21T07:53:10.688ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.452947ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
80972024-12-21T07:53:10.695ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80982024-12-21T07:53:10.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80992024-12-21T07:53:10.725ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.371761ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81002024-12-21T07:53:11.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 620705f1-aacc-431e-9722-bd6a0f555bae roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81012024-12-21T07:53:11.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 620705f1-aacc-431e-9722-bd6a0f555bae resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81022024-12-21T07:53:11.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1633 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 620705f1-aacc-431e-9722-bd6a0f555bae response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81032024-12-21T07:53:11.639ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:42676
81042024-12-21T07:53:11.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42676 req_id = 22f7c38f-195f-4260-9bc9-7326cd94257b roles = RoleSet { roles: {} } uri = /metrics/producers
81052024-12-21T07:53:11.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42676 req_id = 22f7c38f-195f-4260-9bc9-7326cd94257b resource = Database result = Ok(()) uri = /metrics/producers
81062024-12-21T07:53:11.674ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 5518d5c2-1f45-4e85-8fb9-41e1149133a1
81072024-12-21T07:53:11.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34780 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42676 req_id = 22f7c38f-195f-4260-9bc9-7326cd94257b response_code = 201 uri = /metrics/producers
81082024-12-21T07:53:12.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8a2e7212-e162-4bb4-a382-317d08fb5ac5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81092024-12-21T07:53:12.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8a2e7212-e162-4bb4-a382-317d08fb5ac5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81102024-12-21T07:53:12.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8a2e7212-e162-4bb4-a382-317d08fb5ac5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81112024-12-21T07:53:13.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b3843c87-55cb-4e1a-98a7-608f7f23d8bb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81122024-12-21T07:53:13.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b3843c87-55cb-4e1a-98a7-608f7f23d8bb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81132024-12-21T07:53:13.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b3843c87-55cb-4e1a-98a7-608f7f23d8bb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81142024-12-21T07:53:14.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = db179cbe-481d-4020-953d-c83929cfc96b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81152024-12-21T07:53:14.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = db179cbe-481d-4020-953d-c83929cfc96b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81162024-12-21T07:53:14.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2665 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = db179cbe-481d-4020-953d-c83929cfc96b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81172024-12-21T07:53:15.242ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:47810
81182024-12-21T07:53:15.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47810 req_id = 581dacff-a58a-4d0d-8e42-9b592187c1b0 roles = RoleSet { roles: {} } uri = /metrics/producers
81192024-12-21T07:53:15.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47810 req_id = 581dacff-a58a-4d0d-8e42-9b592187c1b0 resource = Database result = Ok(()) uri = /metrics/producers
81202024-12-21T07:53:15.254ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 54344af8-3e4f-4625-a3a8-19b1290c40fc
81212024-12-21T07:53:15.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11726 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47810 req_id = 581dacff-a58a-4d0d-8e42-9b592187c1b0 response_code = 201 uri = /metrics/producers
81222024-12-21T07:53:15.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 16f241ee-fc27-4938-9eb8-533b29bd5be0 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81232024-12-21T07:53:15.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 16f241ee-fc27-4938-9eb8-533b29bd5be0 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81242024-12-21T07:53:15.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 16f241ee-fc27-4938-9eb8-533b29bd5be0 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81252024-12-21T07:53:15.423ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48865
81262024-12-21T07:53:15.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48865 req_id = 50ea205d-d7ff-4996-b1e2-4f0c1d24b776 roles = RoleSet { roles: {} } uri = /metrics/producers
81272024-12-21T07:53:15.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48865 req_id = 50ea205d-d7ff-4996-b1e2-4f0c1d24b776 resource = Database result = Ok(()) uri = /metrics/producers
81282024-12-21T07:53:15.434ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 9c233aaf-fd1f-4081-b1ff-c3b56dd02b1b
81292024-12-21T07:53:15.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10724 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48865 req_id = 50ea205d-d7ff-4996-b1e2-4f0c1d24b776 response_code = 201 uri = /metrics/producers
81302024-12-21T07:53:16.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 33643742-f2dc-4e65-91d8-08c3425611a9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81312024-12-21T07:53:16.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 33643742-f2dc-4e65-91d8-08c3425611a9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81322024-12-21T07:53:16.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 33643742-f2dc-4e65-91d8-08c3425611a9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81332024-12-21T07:53:17.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f359d830-1b8e-4563-a7fc-db4416721bba roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81342024-12-21T07:53:17.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f359d830-1b8e-4563-a7fc-db4416721bba resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81352024-12-21T07:53:17.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f359d830-1b8e-4563-a7fc-db4416721bba response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81362024-12-21T07:53:18.361ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:39757
81372024-12-21T07:53:18.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39757 req_id = 3a7c3e0d-672d-48ab-8271-5a4de1ba823b roles = RoleSet { roles: {} } uri = /metrics/producers
81382024-12-21T07:53:18.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39757 req_id = 3a7c3e0d-672d-48ab-8271-5a4de1ba823b resource = Database result = Ok(()) uri = /metrics/producers
81392024-12-21T07:53:18.368ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81402024-12-21T07:53:18.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7511 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39757 req_id = 3a7c3e0d-672d-48ab-8271-5a4de1ba823b response_code = 201 uri = /metrics/producers
81412024-12-21T07:53:18.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c7940d20-d470-4923-8752-0d5867f40655 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81422024-12-21T07:53:18.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c7940d20-d470-4923-8752-0d5867f40655 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81432024-12-21T07:53:18.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1983 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c7940d20-d470-4923-8752-0d5867f40655 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81442024-12-21T07:53:19.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e0108d70-bca6-4427-bec9-ca6f81184c85 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81452024-12-21T07:53:19.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e0108d70-bca6-4427-bec9-ca6f81184c85 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81462024-12-21T07:53:19.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e0108d70-bca6-4427-bec9-ca6f81184c85 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81472024-12-21T07:53:19.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1378 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 32116405-badc-4dae-a525-0b8898fcc222 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
81482024-12-21T07:53:20.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bba3b386-e3e0-45fa-aa7d-54241e72df15 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81492024-12-21T07:53:20.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bba3b386-e3e0-45fa-aa7d-54241e72df15 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81502024-12-21T07:53:20.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2557 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bba3b386-e3e0-45fa-aa7d-54241e72df15 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81512024-12-21T07:53:20.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
81522024-12-21T07:53:20.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81532024-12-21T07:53:20.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
81542024-12-21T07:53:20.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81552024-12-21T07:53:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81562024-12-21T07:53:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81572024-12-21T07:53:20.668ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81582024-12-21T07:53:20.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81592024-12-21T07:53:20.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81602024-12-21T07:53:20.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81612024-12-21T07:53:20.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81622024-12-21T07:53:20.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81632024-12-21T07:53:20.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81642024-12-21T07:53:20.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81652024-12-21T07:53:20.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81662024-12-21T07:53:20.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
81672024-12-21T07:53:20.681ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81682024-12-21T07:53:20.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81692024-12-21T07:53:20.692ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
81702024-12-21T07:53:20.692ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.977403ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
81712024-12-21T07:53:20.704ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.981422ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81722024-12-21T07:53:21.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dab4e582-f67c-4a17-bd3a-c5874c5c8a29 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81732024-12-21T07:53:21.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dab4e582-f67c-4a17-bd3a-c5874c5c8a29 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81742024-12-21T07:53:21.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1760 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dab4e582-f67c-4a17-bd3a-c5874c5c8a29 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81752024-12-21T07:53:22.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5e272d30-4af6-4805-a03c-128f8cb1acc0 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81762024-12-21T07:53:22.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5e272d30-4af6-4805-a03c-128f8cb1acc0 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81772024-12-21T07:53:22.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5e272d30-4af6-4805-a03c-128f8cb1acc0 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81782024-12-21T07:53:23.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9cf63407-68a5-44ed-8277-4eea6f309b89 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81792024-12-21T07:53:23.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9cf63407-68a5-44ed-8277-4eea6f309b89 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81802024-12-21T07:53:23.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9cf63407-68a5-44ed-8277-4eea6f309b89 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81812024-12-21T07:53:24.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 06382b37-87f2-4392-bc4b-5ed9c571850f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81822024-12-21T07:53:24.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 06382b37-87f2-4392-bc4b-5ed9c571850f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81832024-12-21T07:53:24.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 06382b37-87f2-4392-bc4b-5ed9c571850f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81842024-12-21T07:53:25.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 053fa31a-8fa8-430b-a30b-69ac539d4bd4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81852024-12-21T07:53:25.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 053fa31a-8fa8-430b-a30b-69ac539d4bd4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81862024-12-21T07:53:25.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 053fa31a-8fa8-430b-a30b-69ac539d4bd4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81872024-12-21T07:53:26.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 19b53e36-1037-4e2a-80cd-aa1f5610e6ef roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81882024-12-21T07:53:26.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 19b53e36-1037-4e2a-80cd-aa1f5610e6ef resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81892024-12-21T07:53:26.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 19b53e36-1037-4e2a-80cd-aa1f5610e6ef response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81902024-12-21T07:53:27.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 49fb3f80-e49a-4ab8-bce7-b223079fec7e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81912024-12-21T07:53:27.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 49fb3f80-e49a-4ab8-bce7-b223079fec7e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81922024-12-21T07:53:27.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 49fb3f80-e49a-4ab8-bce7-b223079fec7e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81932024-12-21T07:53:28.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 632e0f38-22ee-4076-ae84-03725b2b020d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81942024-12-21T07:53:28.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 632e0f38-22ee-4076-ae84-03725b2b020d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81952024-12-21T07:53:28.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1864 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 632e0f38-22ee-4076-ae84-03725b2b020d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81962024-12-21T07:53:29.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cb28d83d-c8c1-4300-a5ad-3dea1cccd9a2 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81972024-12-21T07:53:29.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cb28d83d-c8c1-4300-a5ad-3dea1cccd9a2 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81982024-12-21T07:53:29.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cb28d83d-c8c1-4300-a5ad-3dea1cccd9a2 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
81992024-12-21T07:53:29.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1347 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 41ee38c6-621f-4a7d-b9fb-96b82b97fbef response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
82002024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
82012024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
82022024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
82032024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
82042024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82052024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82062024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
82072024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82082024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
82092024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
82102024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82112024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
82122024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82132024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82142024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
82152024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
82162024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82172024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
82182024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
82192024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82202024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
82212024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
82222024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
82232024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
82242024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82252024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
82262024-12-21T07:53:30.666ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
82272024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82282024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82292024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
82302024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82312024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
82322024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82332024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
82342024-12-21T07:53:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82352024-12-21T07:53:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82362024-12-21T07:53:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
82372024-12-21T07:53:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
82382024-12-21T07:53:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82392024-12-21T07:53:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82402024-12-21T07:53:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82412024-12-21T07:53:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82422024-12-21T07:53:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
82432024-12-21T07:53:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82442024-12-21T07:53:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82452024-12-21T07:53:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82462024-12-21T07:53:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82472024-12-21T07:53:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
82482024-12-21T07:53:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82492024-12-21T07:53:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82502024-12-21T07:53:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82512024-12-21T07:53:30.669ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82522024-12-21T07:53:30.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.936329ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
82532024-12-21T07:53:30.670ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82542024-12-21T07:53:30.670ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.632481ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
82552024-12-21T07:53:30.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82562024-12-21T07:53:30.671ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82572024-12-21T07:53:30.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82582024-12-21T07:53:30.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
82592024-12-21T07:53:30.672ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82602024-12-21T07:53:30.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82612024-12-21T07:53:30.673ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82622024-12-21T07:53:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82632024-12-21T07:53:30.676ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82642024-12-21T07:53:30.676ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
82652024-12-21T07:53:30.676ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82662024-12-21T07:53:30.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82672024-12-21T07:53:30.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82682024-12-21T07:53:30.678ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82692024-12-21T07:53:30.678ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82702024-12-21T07:53:30.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82712024-12-21T07:53:30.678ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 377400912 } })
82722024-12-21T07:53:30.678ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
82732024-12-21T07:53:30.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e09660de-a5ca-4ae2-a2ab-a7476f56bebb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
82742024-12-21T07:53:30.681ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82752024-12-21T07:53:30.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e09660de-a5ca-4ae2-a2ab-a7476f56bebb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
82762024-12-21T07:53:30.681ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 381090974 } })
82772024-12-21T07:53:30.682ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
82782024-12-21T07:53:30.682ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82792024-12-21T07:53:30.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82802024-12-21T07:53:30.683ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82812024-12-21T07:53:30.683ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82822024-12-21T07:53:30.683ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
82832024-12-21T07:53:30.683ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82842024-12-21T07:53:30.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82852024-12-21T07:53:30.683ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1544, tv_nsec: 382832832 } })
82862024-12-21T07:53:30.684ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
82872024-12-21T07:53:30.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e09660de-a5ca-4ae2-a2ab-a7476f56bebb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
82882024-12-21T07:53:30.684ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82892024-12-21T07:53:30.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82902024-12-21T07:53:30.684ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82912024-12-21T07:53:30.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82922024-12-21T07:53:30.685ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82932024-12-21T07:53:30.685ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82942024-12-21T07:53:30.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82952024-12-21T07:53:30.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82962024-12-21T07:53:30.688ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82972024-12-21T07:53:30.688ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82982024-12-21T07:53:30.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82992024-12-21T07:53:30.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83002024-12-21T07:53:30.689ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83012024-12-21T07:53:30.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
83022024-12-21T07:53:30.694ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83032024-12-21T07:53:30.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83042024-12-21T07:53:30.696ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 29.954149ms iteration = 26 status = {"physical_disks_added":0}
83052024-12-21T07:53:30.702ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
83062024-12-21T07:53:30.702ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.199892ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
83072024-12-21T07:53:30.719ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83082024-12-21T07:53:30.720ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83092024-12-21T07:53:30.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83102024-12-21T07:53:30.720ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83112024-12-21T07:53:30.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83122024-12-21T07:53:30.721ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.565348ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
83132024-12-21T07:53:30.721ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83142024-12-21T07:53:30.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83152024-12-21T07:53:30.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83162024-12-21T07:53:30.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83172024-12-21T07:53:30.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
83182024-12-21T07:53:30.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83192024-12-21T07:53:30.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83202024-12-21T07:53:30.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83212024-12-21T07:53:30.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83222024-12-21T07:53:30.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83232024-12-21T07:53:30.726ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83242024-12-21T07:53:30.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.625053ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83252024-12-21T07:53:30.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83262024-12-21T07:53:30.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
83272024-12-21T07:53:30.727ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83282024-12-21T07:53:30.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83292024-12-21T07:53:30.736ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83302024-12-21T07:53:30.736ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
83312024-12-21T07:53:30.736ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 69.70018ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
83322024-12-21T07:53:30.749ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 83.085383ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
83332024-12-21T07:53:30.751ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83342024-12-21T07:53:30.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83352024-12-21T07:53:30.753ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83362024-12-21T07:53:30.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83372024-12-21T07:53:30.761ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 94.814137ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
83382024-12-21T07:53:30.761ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
83392024-12-21T07:53:30.761ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83402024-12-21T07:53:30.762ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "213c2797-f9dd-41f3-80a9-fa605546fb0a", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:30 GMT"} })
83412024-12-21T07:53:30.762ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83422024-12-21T07:53:30.764ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83432024-12-21T07:53:30.765ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 98.456328ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
83442024-12-21T07:53:30.769ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
83452024-12-21T07:53:30.769ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 102.311352ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
83462024-12-21T07:53:30.769ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
83472024-12-21T07:53:30.769ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83482024-12-21T07:53:30.770ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "74e9573d-b52b-41ed-a42b-b55114251347", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:30 GMT"} })
83492024-12-21T07:53:30.770ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83502024-12-21T07:53:30.770ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
83512024-12-21T07:53:30.770ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83522024-12-21T07:53:30.771ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "931d4cf9-1489-426d-8c14-fbda26fde29e", "content-length": "26", "date": "Sat, 21 Dec 2024 07:53:30 GMT"} })
83532024-12-21T07:53:30.771ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83542024-12-21T07:53:30.771ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83552024-12-21T07:53:30.773ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
83562024-12-21T07:53:30.784ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83572024-12-21T07:53:30.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
83582024-12-21T07:53:30.787ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83592024-12-21T07:53:30.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83602024-12-21T07:53:30.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = b5cee352-bb5d-482c-8859-c9092ef91568 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
83612024-12-21T07:53:30.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = b5cee352-bb5d-482c-8859-c9092ef91568 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
83622024-12-21T07:53:30.833ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83632024-12-21T07:53:30.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83642024-12-21T07:53:30.869ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
83652024-12-21T07:53:30.869ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83662024-12-21T07:53:30.869ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "db50eb22-f015-45d9-ad09-b8994b3ab0e6", "content-length": "372", "date": "Sat, 21 Dec 2024 07:53:29 GMT"} })
83672024-12-21T07:53:30.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83682024-12-21T07:53:30.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83692024-12-21T07:53:30.871ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 204.573444ms iteration = 22 status = 0
83702024-12-21T07:53:30.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83712024-12-21T07:53:30.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = b5cee352-bb5d-482c-8859-c9092ef91568 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
83722024-12-21T07:53:30.874ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83732024-12-21T07:53:30.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83742024-12-21T07:53:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83752024-12-21T07:53:30.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83762024-12-21T07:53:30.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83772024-12-21T07:53:30.877ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83782024-12-21T07:53:30.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83792024-12-21T07:53:30.880ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
83802024-12-21T07:53:30.881ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c812d13e-96db-4ae9-a284-0635d04f0432", "content-length": "1", "date": "Sat, 21 Dec 2024 07:53:30 GMT"} })
83812024-12-21T07:53:30.882ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83822024-12-21T07:53:30.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83832024-12-21T07:53:30.884ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 217.5644ms iteration = 22 status = null
83842024-12-21T07:53:30.885ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 218.969473ms iteration = 22 status = {}
83852024-12-21T07:53:30.888ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
83862024-12-21T07:53:30.888ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
83872024-12-21T07:53:30.888ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f4d8c9f0-df15-45c6-b38d-807d805903b3", "date": "Sat, 21 Dec 2024 07:53:29 GMT"} })
83882024-12-21T07:53:30.888ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83892024-12-21T07:53:30.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83902024-12-21T07:53:30.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83912024-12-21T07:53:30.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83922024-12-21T07:53:30.893ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83932024-12-21T07:53:30.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83942024-12-21T07:53:30.896ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
83952024-12-21T07:53:30.896ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83962024-12-21T07:53:30.897ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f45dc3cc-5cbc-4612-ab56-83729829fc50", "date": "Sat, 21 Dec 2024 07:53:30 GMT"} })
83972024-12-21T07:53:30.899ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 232.447588ms iteration = 23 status = {}
83982024-12-21T07:53:30.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83992024-12-21T07:53:30.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84002024-12-21T07:53:30.968ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
84012024-12-21T07:53:30.969ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca4804c2-5e07-4497-abad-ca10c03a3c9f", "content-length": "691", "date": "Sat, 21 Dec 2024 07:53:30 GMT"} })
84022024-12-21T07:53:30.969ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
84032024-12-21T07:53:30.969ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
84042024-12-21T07:53:30.969ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
84052024-12-21T07:53:30.970ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 303.749185ms iteration = 22 status = {}
84062024-12-21T07:53:30.972ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
84072024-12-21T07:53:30.972ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84082024-12-21T07:53:30.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84092024-12-21T07:53:30.985ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
84102024-12-21T07:53:30.986ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "00c2877d-cb71-49d2-980a-5a1a88b585b4", "content-length": "134", "date": "Sat, 21 Dec 2024 07:53:30 GMT"} })
84112024-12-21T07:53:30.986ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
84122024-12-21T07:53:30.986ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
84132024-12-21T07:53:30.986ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
84142024-12-21T07:53:30.986ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
84152024-12-21T07:53:30.986ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84162024-12-21T07:53:30.986ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84172024-12-21T07:53:30.986ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84182024-12-21T07:53:30.986ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84192024-12-21T07:53:30.986ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84202024-12-21T07:53:30.986ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84212024-12-21T07:53:30.987ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
84222024-12-21T07:53:30.987ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84232024-12-21T07:53:30.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84242024-12-21T07:53:30.989ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
84252024-12-21T07:53:30.989ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1deaa3a3-073d-4be3-91e6-f674a38a2b82", "content-length": "2", "date": "Sat, 21 Dec 2024 07:53:30 GMT"} })
84262024-12-21T07:53:30.989ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
84272024-12-21T07:53:30.989ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3fca607-58fd-4f12-8b78-9502e882b02f", "content-length": "52", "date": "Sat, 21 Dec 2024 07:53:30 GMT"} })
84282024-12-21T07:53:30.989ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
84292024-12-21T07:53:30.989ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
84302024-12-21T07:53:31.088ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "12a85428-575c-46a3-95d1-f05bc8c4982f", "date": "Sat, 21 Dec 2024 07:53:30 GMT"} })
84312024-12-21T07:53:31.088ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
84322024-12-21T07:53:31.088ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
84332024-12-21T07:53:31.088ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b81831d9-476b-48b2-ba94-ee0c8e2ed633", "content-length": "682", "date": "Sat, 21 Dec 2024 07:53:30 GMT"} })
84342024-12-21T07:53:31.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84352024-12-21T07:53:31.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84362024-12-21T07:53:31.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84372024-12-21T07:53:31.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84382024-12-21T07:53:31.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84392024-12-21T07:53:31.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84402024-12-21T07:53:31.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84412024-12-21T07:53:31.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84422024-12-21T07:53:31.106ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 439.544044ms iteration = 22 status = {}
84432024-12-21T07:53:31.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6fe9e17b-419f-4024-81d7-f0e4ac3783ba roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84442024-12-21T07:53:31.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6fe9e17b-419f-4024-81d7-f0e4ac3783ba resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84452024-12-21T07:53:31.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6fe9e17b-419f-4024-81d7-f0e4ac3783ba response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84462024-12-21T07:53:32.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 90cfa124-b33e-4df3-a192-b6ce5aaad52b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84472024-12-21T07:53:32.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 90cfa124-b33e-4df3-a192-b6ce5aaad52b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84482024-12-21T07:53:32.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 90cfa124-b33e-4df3-a192-b6ce5aaad52b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84492024-12-21T07:53:33.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4f99c4c4-c7bc-4762-be93-08cb804a818c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84502024-12-21T07:53:33.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4f99c4c4-c7bc-4762-be93-08cb804a818c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84512024-12-21T07:53:33.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4f99c4c4-c7bc-4762-be93-08cb804a818c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84522024-12-21T07:53:34.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 8cf18f3d-a192-47a8-a6cd-48e3767609de roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
84532024-12-21T07:53:34.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 8cf18f3d-a192-47a8-a6cd-48e3767609de resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
84542024-12-21T07:53:34.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 8cf18f3d-a192-47a8-a6cd-48e3767609de response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
84552024-12-21T07:53:34.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 9a5c9a82-9c40-4987-a539-8e3bf37d90b5 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
84562024-12-21T07:53:34.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 9a5c9a82-9c40-4987-a539-8e3bf37d90b5 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
84572024-12-21T07:53:34.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 9a5c9a82-9c40-4987-a539-8e3bf37d90b5 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
84582024-12-21T07:53:34.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ff331707-cf83-4706-a66c-68a8e5d67e44 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84592024-12-21T07:53:34.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ff331707-cf83-4706-a66c-68a8e5d67e44 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84602024-12-21T07:53:34.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ff331707-cf83-4706-a66c-68a8e5d67e44 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84612024-12-21T07:53:35.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e0420101-1c04-4a22-a040-f1d5b6dcf828 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84622024-12-21T07:53:35.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e0420101-1c04-4a22-a040-f1d5b6dcf828 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84632024-12-21T07:53:35.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e0420101-1c04-4a22-a040-f1d5b6dcf828 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84642024-12-21T07:53:36.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4cbdcd6c-d1d9-4eb0-a3bc-9556de6e742d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84652024-12-21T07:53:36.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4cbdcd6c-d1d9-4eb0-a3bc-9556de6e742d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84662024-12-21T07:53:36.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4cbdcd6c-d1d9-4eb0-a3bc-9556de6e742d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84672024-12-21T07:53:37.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e2f3789e-eaf7-4000-b59b-cede14911a5b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84682024-12-21T07:53:37.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e2f3789e-eaf7-4000-b59b-cede14911a5b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84692024-12-21T07:53:37.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e2f3789e-eaf7-4000-b59b-cede14911a5b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84702024-12-21T07:53:38.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 00079651-65dd-466c-9665-8520714f356b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84712024-12-21T07:53:38.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 00079651-65dd-466c-9665-8520714f356b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84722024-12-21T07:53:38.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2717 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 00079651-65dd-466c-9665-8520714f356b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84732024-12-21T07:53:39.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1532 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 31186f73-21ab-4cf4-89e1-77755fbd0de9 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
84742024-12-21T07:53:39.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 56af7e07-5b4d-4423-ba64-6e2e184b8cfb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84752024-12-21T07:53:39.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 56af7e07-5b4d-4423-ba64-6e2e184b8cfb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84762024-12-21T07:53:39.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 56af7e07-5b4d-4423-ba64-6e2e184b8cfb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84772024-12-21T07:53:40.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
84782024-12-21T07:53:40.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84792024-12-21T07:53:40.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
84802024-12-21T07:53:40.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84812024-12-21T07:53:40.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84822024-12-21T07:53:40.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84832024-12-21T07:53:40.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84842024-12-21T07:53:40.669ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84852024-12-21T07:53:40.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84862024-12-21T07:53:40.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84872024-12-21T07:53:40.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84882024-12-21T07:53:40.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84892024-12-21T07:53:40.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84902024-12-21T07:53:40.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84912024-12-21T07:53:40.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84922024-12-21T07:53:40.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
84932024-12-21T07:53:40.680ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84942024-12-21T07:53:40.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84952024-12-21T07:53:40.691ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
84962024-12-21T07:53:40.691ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.932254ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
84972024-12-21T07:53:40.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.320858ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84982024-12-21T07:53:40.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6aed6db8-c554-4577-9e77-d1a81945cf91 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
84992024-12-21T07:53:40.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6aed6db8-c554-4577-9e77-d1a81945cf91 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85002024-12-21T07:53:40.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6aed6db8-c554-4577-9e77-d1a81945cf91 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85012024-12-21T07:53:41.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 97b35e8b-b5d1-4178-9b34-ebd0c5df9938 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85022024-12-21T07:53:41.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 97b35e8b-b5d1-4178-9b34-ebd0c5df9938 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85032024-12-21T07:53:41.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 97b35e8b-b5d1-4178-9b34-ebd0c5df9938 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85042024-12-21T07:53:42.816ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
85052024-12-21T07:53:42.816ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
85062024-12-21T07:53:42.846ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
85072024-12-21T07:53:42.847ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:63231
85082024-12-21T07:53:42.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:63231 req_id = 6b9145d0-d980-4e36-accb-53604ec6cb12 roles = RoleSet { roles: {} } uri = /metrics/producers
85092024-12-21T07:53:42.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:63231 req_id = 6b9145d0-d980-4e36-accb-53604ec6cb12 resource = Database result = Ok(()) uri = /metrics/producers
85102024-12-21T07:53:42.891ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = a920b126-b55b-45c8-9984-5279bf662759
85112024-12-21T07:53:42.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43898 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:63231 req_id = 6b9145d0-d980-4e36-accb-53604ec6cb12 response_code = 201 uri = /metrics/producers
85122024-12-21T07:53:42.891ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "6b9145d0-d980-4e36-accb-53604ec6cb12", "content-length": "41", "date": "Sat, 21 Dec 2024 07:53:42 GMT"} })
85132024-12-21T07:53:42.892ZDEBGnexus (producer-registration-task): registered with nexus successfully
85142024-12-21T07:53:42.892ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
85152024-12-21T07:53:42.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 989fb443-02e7-4380-b41e-698ea884a52f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85162024-12-21T07:53:42.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 989fb443-02e7-4380-b41e-698ea884a52f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85172024-12-21T07:53:42.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 989fb443-02e7-4380-b41e-698ea884a52f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85182024-12-21T07:53:43.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 748a2f7e-8de1-4db9-9b4f-af6c811d45bf roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85192024-12-21T07:53:43.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 748a2f7e-8de1-4db9-9b4f-af6c811d45bf resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85202024-12-21T07:53:43.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 748a2f7e-8de1-4db9-9b4f-af6c811d45bf response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85212024-12-21T07:53:44.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 771a05ab-2ff9-4171-ab77-450b1884a1bf roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85222024-12-21T07:53:44.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 771a05ab-2ff9-4171-ab77-450b1884a1bf resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85232024-12-21T07:53:44.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1704 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 771a05ab-2ff9-4171-ab77-450b1884a1bf response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85242024-12-21T07:53:46.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8227c27-2228-46b1-941f-cc5319b87698 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85252024-12-21T07:53:46.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8227c27-2228-46b1-941f-cc5319b87698 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85262024-12-21T07:53:46.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8227c27-2228-46b1-941f-cc5319b87698 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85272024-12-21T07:53:47.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5b12c3c9-b717-4ce7-ab5a-06ed2a525b48 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85282024-12-21T07:53:47.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5b12c3c9-b717-4ce7-ab5a-06ed2a525b48 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85292024-12-21T07:53:47.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5b12c3c9-b717-4ce7-ab5a-06ed2a525b48 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85302024-12-21T07:53:48.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ea17e68b-6847-48b9-87a0-7c5aa76d7b9c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85312024-12-21T07:53:48.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ea17e68b-6847-48b9-87a0-7c5aa76d7b9c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85322024-12-21T07:53:48.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ea17e68b-6847-48b9-87a0-7c5aa76d7b9c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85332024-12-21T07:53:49.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 76d24f9f-1cc9-4494-8678-418ed5d2ae4c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85342024-12-21T07:53:49.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 76d24f9f-1cc9-4494-8678-418ed5d2ae4c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85352024-12-21T07:53:49.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1790 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 76d24f9f-1cc9-4494-8678-418ed5d2ae4c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85362024-12-21T07:53:49.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1308 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 4aa509b3-3aff-44cd-94cd-181d696fce7d response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
85372024-12-21T07:53:50.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7065ee6c-1982-403b-8164-df90803900ae roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85382024-12-21T07:53:50.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7065ee6c-1982-403b-8164-df90803900ae resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85392024-12-21T07:53:50.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7065ee6c-1982-403b-8164-df90803900ae response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85402024-12-21T07:53:50.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
85412024-12-21T07:53:50.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85422024-12-21T07:53:50.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
85432024-12-21T07:53:50.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85442024-12-21T07:53:50.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85452024-12-21T07:53:50.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85462024-12-21T07:53:50.669ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85472024-12-21T07:53:50.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85482024-12-21T07:53:50.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85492024-12-21T07:53:50.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.304611ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85502024-12-21T07:53:50.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85512024-12-21T07:53:50.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85522024-12-21T07:53:50.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85532024-12-21T07:53:50.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85542024-12-21T07:53:50.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85552024-12-21T07:53:50.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85562024-12-21T07:53:50.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
85572024-12-21T07:53:50.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85582024-12-21T07:53:50.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85592024-12-21T07:53:50.691ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
85602024-12-21T07:53:50.691ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.735352ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
85612024-12-21T07:53:51.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 44f9ee65-c39c-4a38-a699-5e2148c49710 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85622024-12-21T07:53:51.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 44f9ee65-c39c-4a38-a699-5e2148c49710 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85632024-12-21T07:53:51.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 44f9ee65-c39c-4a38-a699-5e2148c49710 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85642024-12-21T07:53:52.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2e088b67-6c46-4f14-a684-e69331092197 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85652024-12-21T07:53:52.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2e088b67-6c46-4f14-a684-e69331092197 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85662024-12-21T07:53:52.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2e088b67-6c46-4f14-a684-e69331092197 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85672024-12-21T07:53:53.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3e93705a-e22c-4172-8ffb-aac60405cdfb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85682024-12-21T07:53:53.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3e93705a-e22c-4172-8ffb-aac60405cdfb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85692024-12-21T07:53:53.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3e93705a-e22c-4172-8ffb-aac60405cdfb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85702024-12-21T07:53:54.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eb01f7b4-65ca-4ab8-aa4c-a4e2e29d5e47 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85712024-12-21T07:53:54.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eb01f7b4-65ca-4ab8-aa4c-a4e2e29d5e47 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85722024-12-21T07:53:54.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eb01f7b4-65ca-4ab8-aa4c-a4e2e29d5e47 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85732024-12-21T07:53:55.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 44a73439-61f8-48a9-97de-0763d4c952e8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85742024-12-21T07:53:55.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 44a73439-61f8-48a9-97de-0763d4c952e8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85752024-12-21T07:53:55.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 44a73439-61f8-48a9-97de-0763d4c952e8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85762024-12-21T07:53:56.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 52bad6be-e48d-4a22-a38d-a70eb7b64dbc roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85772024-12-21T07:53:56.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 52bad6be-e48d-4a22-a38d-a70eb7b64dbc resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85782024-12-21T07:53:56.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2652 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 52bad6be-e48d-4a22-a38d-a70eb7b64dbc response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85792024-12-21T07:53:57.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 49f27534-2c84-4908-85e0-8ec7f94d3d2c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85802024-12-21T07:53:57.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 49f27534-2c84-4908-85e0-8ec7f94d3d2c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85812024-12-21T07:53:57.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 49f27534-2c84-4908-85e0-8ec7f94d3d2c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85822024-12-21T07:53:58.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 620edae2-9a6b-4ff8-b3d3-9f3f4f1816a5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85832024-12-21T07:53:58.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 620edae2-9a6b-4ff8-b3d3-9f3f4f1816a5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85842024-12-21T07:53:58.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 620edae2-9a6b-4ff8-b3d3-9f3f4f1816a5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85852024-12-21T07:53:59.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d163a92b-119e-450c-b96b-b2c0e690f225 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85862024-12-21T07:53:59.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d163a92b-119e-450c-b96b-b2c0e690f225 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85872024-12-21T07:53:59.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d163a92b-119e-450c-b96b-b2c0e690f225 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85882024-12-21T07:53:59.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1313 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 7cfbbf6f-aa85-493f-9777-b82f0726f2ca response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
85892024-12-21T07:54:00.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 31df977d-1a20-47be-8e11-a79f3282467f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85902024-12-21T07:54:00.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 31df977d-1a20-47be-8e11-a79f3282467f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85912024-12-21T07:54:00.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 31df977d-1a20-47be-8e11-a79f3282467f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
85922024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
85932024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
85942024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85952024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
85962024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85972024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
85982024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
85992024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86002024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
86012024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
86022024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
86032024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
86042024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86052024-12-21T07:54:00.667ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:44:00.667215424 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
86062024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
86072024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
86082024-12-21T07:54:00.667ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b
86092024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.75\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b"}
86102024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
86112024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
86122024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
86132024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
86142024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
86152024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86162024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
86172024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
86182024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
86192024-12-21T07:54:00.667ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
86202024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
86212024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
86222024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
86232024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86242024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86252024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
86262024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
86272024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86282024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86292024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
86302024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
86312024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
86322024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86332024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
86342024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
86352024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
86362024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
86372024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
86382024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
86392024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
86402024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86412024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
86422024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
86432024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86442024-12-21T07:54:00.667ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
86452024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
86462024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86472024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
86482024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86492024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86502024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
86512024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
86522024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86532024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
86542024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86552024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86562024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86572024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
86582024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86592024-12-21T07:54:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86602024-12-21T07:54:00.668ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bfae345-1659-4377-bca9-c55abec2aeb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7c426166-4f75-4a87-b9ac-c0d590aea49b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1574, tv_nsec: 366999222 } })
86612024-12-21T07:54:00.668ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dd95bbd-e009-486c-8c96-451a6e195a49.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1574, tv_nsec: 367103394 } })
86622024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86632024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
86642024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
86652024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86662024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86672024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86682024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
86692024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86702024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86712024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86722024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
86732024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
86742024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
86752024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86762024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86772024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
86782024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
86792024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86802024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
86812024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.290852ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
86822024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
86832024-12-21T07:54:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.495464ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
86842024-12-21T07:54:00.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86852024-12-21T07:54:00.670ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1574, tv_nsec: 369383352 } })
86862024-12-21T07:54:00.670ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
86872024-12-21T07:54:00.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86882024-12-21T07:54:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86892024-12-21T07:54:00.671ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.889665ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
86902024-12-21T07:54:00.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
86912024-12-21T07:54:00.671ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86922024-12-21T07:54:00.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86932024-12-21T07:54:00.671ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:44:00.667215424 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
86942024-12-21T07:54:00.671ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.760469ms iteration = 12 status = {"expiration":"2024-12-21T07:44:00.667215424Z","pruned":[]}
86952024-12-21T07:54:00.674ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.423434ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
86962024-12-21T07:54:00.674ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86972024-12-21T07:54:00.674ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86982024-12-21T07:54:00.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86992024-12-21T07:54:00.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87002024-12-21T07:54:00.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87012024-12-21T07:54:00.676ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
87022024-12-21T07:54:00.676ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
87032024-12-21T07:54:00.676ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 9.189173ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
87042024-12-21T07:54:00.676ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87052024-12-21T07:54:00.676ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87062024-12-21T07:54:00.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87072024-12-21T07:54:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87082024-12-21T07:54:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87092024-12-21T07:54:00.678ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87102024-12-21T07:54:00.678ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87112024-12-21T07:54:00.679ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87122024-12-21T07:54:00.680ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87132024-12-21T07:54:00.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
87142024-12-21T07:54:00.680ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87152024-12-21T07:54:00.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87162024-12-21T07:54:00.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
87172024-12-21T07:54:00.681ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87182024-12-21T07:54:00.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87192024-12-21T07:54:00.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
87202024-12-21T07:54:00.682ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87212024-12-21T07:54:00.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87222024-12-21T07:54:00.685ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
87232024-12-21T07:54:00.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87242024-12-21T07:54:00.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87252024-12-21T07:54:00.690ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1574, tv_nsec: 389899983 } })
87262024-12-21T07:54:00.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
87272024-12-21T07:54:00.692ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.123468ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87282024-12-21T07:54:00.692ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1574, tv_nsec: 391914867 } })
87292024-12-21T07:54:00.693ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
87302024-12-21T07:54:00.693ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 26.214876ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
87312024-12-21T07:54:00.695ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87322024-12-21T07:54:00.695ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87332024-12-21T07:54:00.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87342024-12-21T07:54:00.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87352024-12-21T07:54:00.707ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87362024-12-21T07:54:00.707ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
87372024-12-21T07:54:00.707ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87382024-12-21T07:54:00.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87392024-12-21T07:54:00.712ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87402024-12-21T07:54:00.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87412024-12-21T07:54:00.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87422024-12-21T07:54:00.724ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87432024-12-21T07:54:00.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87442024-12-21T07:54:00.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87452024-12-21T07:54:00.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87462024-12-21T07:54:00.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87472024-12-21T07:54:00.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87482024-12-21T07:54:00.729ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87492024-12-21T07:54:00.730ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87502024-12-21T07:54:00.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
87512024-12-21T07:54:00.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87522024-12-21T07:54:00.733ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87532024-12-21T07:54:00.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87542024-12-21T07:54:00.733ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87552024-12-21T07:54:00.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87562024-12-21T07:54:00.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87572024-12-21T07:54:00.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
87582024-12-21T07:54:00.735ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87592024-12-21T07:54:00.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87602024-12-21T07:54:00.737ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87612024-12-21T07:54:00.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87622024-12-21T07:54:00.737ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.913763ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
87632024-12-21T07:54:00.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87642024-12-21T07:54:00.738ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
87652024-12-21T07:54:00.738ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
87662024-12-21T07:54:00.738ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 70.692957ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
87672024-12-21T07:54:00.738ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.546ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
87682024-12-21T07:54:00.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87692024-12-21T07:54:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87702024-12-21T07:54:00.741ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87712024-12-21T07:54:00.741ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87722024-12-21T07:54:00.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87732024-12-21T07:54:00.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87742024-12-21T07:54:00.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87752024-12-21T07:54:00.742ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87762024-12-21T07:54:00.742ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
87772024-12-21T07:54:00.742ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.597437ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
87782024-12-21T07:54:00.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87792024-12-21T07:54:00.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
87802024-12-21T07:54:00.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87812024-12-21T07:54:00.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87822024-12-21T07:54:00.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87832024-12-21T07:54:00.746ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87842024-12-21T07:54:00.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87852024-12-21T07:54:00.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
87862024-12-21T07:54:00.754ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87872024-12-21T07:54:00.754ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
87882024-12-21T07:54:00.754ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87892024-12-21T07:54:00.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87902024-12-21T07:54:00.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87912024-12-21T07:54:00.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87922024-12-21T07:54:00.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
87932024-12-21T07:54:00.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
87942024-12-21T07:54:00.768ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
87952024-12-21T07:54:00.768ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
87962024-12-21T07:54:00.768ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
87972024-12-21T07:54:00.768ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87982024-12-21T07:54:00.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87992024-12-21T07:54:00.769ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88002024-12-21T07:54:00.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88012024-12-21T07:54:00.770ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 102.702178ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88022024-12-21T07:54:00.775ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
88032024-12-21T07:54:00.775ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
88042024-12-21T07:54:00.775ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
88052024-12-21T07:54:00.775ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88062024-12-21T07:54:00.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88072024-12-21T07:54:00.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88082024-12-21T07:54:00.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88092024-12-21T07:54:00.822ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
88102024-12-21T07:54:00.831ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
88112024-12-21T07:54:00.856ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
88122024-12-21T07:54:00.856ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88132024-12-21T07:54:00.857ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b906c708-c171-45d3-80f6-1997a9465153", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:00 GMT"} })
88142024-12-21T07:54:00.857ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88152024-12-21T07:54:00.859ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88162024-12-21T07:54:00.861ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
88172024-12-21T07:54:00.861ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88182024-12-21T07:54:00.862ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c764ef6e-8290-4382-bb8b-a5c8a3514c12", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:00 GMT"} })
88192024-12-21T07:54:00.862ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88202024-12-21T07:54:00.864ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
88212024-12-21T07:54:00.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 9d1d1a4c-7d50-4405-b8b3-6fad1e15eabd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
88222024-12-21T07:54:00.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 9d1d1a4c-7d50-4405-b8b3-6fad1e15eabd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
88232024-12-21T07:54:00.931ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
88242024-12-21T07:54:00.931ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88252024-12-21T07:54:00.931ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "67e8b55d-ea31-440b-8c35-84906ba199a2", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:00 GMT"} })
88262024-12-21T07:54:00.931ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88272024-12-21T07:54:00.933ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88282024-12-21T07:54:01.022ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
88292024-12-21T07:54:01.022ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0ea7c546-e11f-48bf-981c-f2d5c03dd8fc", "date": "Sat, 21 Dec 2024 07:54:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
88302024-12-21T07:54:01.022ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
88312024-12-21T07:54:01.024ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2fb2a355-6ac7-4bdc-a5e3-9e73330f39cf", "date": "Sat, 21 Dec 2024 07:54:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
88322024-12-21T07:54:01.024ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
88332024-12-21T07:54:01.025ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
88342024-12-21T07:54:01.025ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 358.420543ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
88352024-12-21T07:54:01.085ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
88362024-12-21T07:54:01.094ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
88372024-12-21T07:54:01.094ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88382024-12-21T07:54:01.094ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "388c1283-7262-4a26-af1a-98419ff032c3", "content-length": "372", "date": "Sat, 21 Dec 2024 07:54:01 GMT"} })
88392024-12-21T07:54:01.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88402024-12-21T07:54:01.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88412024-12-21T07:54:01.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88422024-12-21T07:54:01.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88432024-12-21T07:54:01.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88442024-12-21T07:54:01.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88452024-12-21T07:54:01.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 9d1d1a4c-7d50-4405-b8b3-6fad1e15eabd response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
88462024-12-21T07:54:01.124ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
88472024-12-21T07:54:01.124ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 456.908723ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
88482024-12-21T07:54:01.142ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 475.358979ms iteration = 23 status = {}
88492024-12-21T07:54:01.142ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
88502024-12-21T07:54:01.142ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 0 version = 2
88512024-12-21T07:54:01.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88522024-12-21T07:54:01.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88532024-12-21T07:54:01.150ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88542024-12-21T07:54:01.150ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
88552024-12-21T07:54:01.150ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 483.405963ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
88562024-12-21T07:54:01.150ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88572024-12-21T07:54:01.150ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88582024-12-21T07:54:01.151ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88592024-12-21T07:54:01.152ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 485.165673ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
88602024-12-21T07:54:01.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88612024-12-21T07:54:01.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88622024-12-21T07:54:01.154ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
88632024-12-21T07:54:01.154ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88642024-12-21T07:54:01.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88652024-12-21T07:54:01.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88662024-12-21T07:54:01.155ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
88672024-12-21T07:54:01.155ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88682024-12-21T07:54:01.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88692024-12-21T07:54:01.156ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
88702024-12-21T07:54:01.156ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
88712024-12-21T07:54:01.156ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88722024-12-21T07:54:01.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88732024-12-21T07:54:01.158ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 490.957749ms iteration = 23 status = 0
88742024-12-21T07:54:01.167ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
88752024-12-21T07:54:01.167ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
88762024-12-21T07:54:01.167ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ac3a3897-e303-41b8-9a9f-08844d39afdb", "date": "Sat, 21 Dec 2024 07:54:01 GMT"} })
88772024-12-21T07:54:01.168ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88782024-12-21T07:54:01.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88792024-12-21T07:54:01.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88802024-12-21T07:54:01.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88812024-12-21T07:54:01.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88822024-12-21T07:54:01.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88832024-12-21T07:54:01.177ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88842024-12-21T07:54:01.177ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
88852024-12-21T07:54:01.177ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88862024-12-21T07:54:01.177ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2508383a-4f43-433a-b8e3-388d8bfe9690", "date": "Sat, 21 Dec 2024 07:54:01 GMT"} })
88872024-12-21T07:54:01.180ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 512.509458ms iteration = 24 status = {}
88882024-12-21T07:54:01.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88892024-12-21T07:54:01.180ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88902024-12-21T07:54:01.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88912024-12-21T07:54:01.182ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 1 version = 2
88922024-12-21T07:54:01.182ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
88932024-12-21T07:54:01.182ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:43:41.075205 UTC dns_group = external generation = 2
88942024-12-21T07:54:01.182ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 515.02739ms iteration = 13 status = {"generation":2}
88952024-12-21T07:54:01.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88962024-12-21T07:54:01.193ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88972024-12-21T07:54:01.193ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88982024-12-21T07:54:01.193ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:42:50.264108Z, time_modified: 2024-12-21T07:42:50.264108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }) }
88992024-12-21T07:54:01.193ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 525.914561ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]}},"default_endpoint":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
89002024-12-21T07:54:01.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89012024-12-21T07:54:01.195ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
89022024-12-21T07:54:01.195ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
89032024-12-21T07:54:01.195ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:43:39.444085 UTC dns_group = internal generation = 1
89042024-12-21T07:54:01.195ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 528.477303ms iteration = 13 status = {"generation":1}
89052024-12-21T07:54:01.203ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
89062024-12-21T07:54:01.203ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 535.734494ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
89072024-12-21T07:54:01.215ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
89082024-12-21T07:54:01.215ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d8da101-c3f8-4711-8bb9-4a101ca33ecb", "content-length": "1", "date": "Sat, 21 Dec 2024 07:54:00 GMT"} })
89092024-12-21T07:54:01.217ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89102024-12-21T07:54:01.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89112024-12-21T07:54:01.219ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 552.072705ms iteration = 23 status = null
89122024-12-21T07:54:01.223ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 555.528864ms iteration = 27 status = {"physical_disks_added":0}
89132024-12-21T07:54:01.229ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89142024-12-21T07:54:01.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89152024-12-21T07:54:01.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89162024-12-21T07:54:01.232ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89172024-12-21T07:54:01.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89182024-12-21T07:54:01.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89192024-12-21T07:54:01.234ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89202024-12-21T07:54:01.236ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89212024-12-21T07:54:01.236ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89222024-12-21T07:54:01.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89232024-12-21T07:54:01.248ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
89242024-12-21T07:54:01.248ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ff536de7-12fd-4df5-aa7d-220a1c4466ed", "date": "Sat, 21 Dec 2024 07:54:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
89252024-12-21T07:54:01.248ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
89262024-12-21T07:54:01.250ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "162bd27d-3b02-421e-94f6-c1ecf6c82c79", "date": "Sat, 21 Dec 2024 07:54:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
89272024-12-21T07:54:01.250ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
89282024-12-21T07:54:01.251ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a86872f0-875f-436d-9bf7-b259f3ab0a9f", "date": "Sat, 21 Dec 2024 07:54:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
89292024-12-21T07:54:01.251ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
89302024-12-21T07:54:01.253ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
89312024-12-21T07:54:01.253ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 586.502988ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
89322024-12-21T07:54:01.260ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89332024-12-21T07:54:01.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89342024-12-21T07:54:01.262ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
89352024-12-21T07:54:01.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89362024-12-21T07:54:01.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89372024-12-21T07:54:01.271ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
89382024-12-21T07:54:01.272ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4408836d-588b-44b7-b6c2-6090a672888a", "content-length": "134", "date": "Sat, 21 Dec 2024 07:54:00 GMT"} })
89392024-12-21T07:54:01.272ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
89402024-12-21T07:54:01.272ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
89412024-12-21T07:54:01.272ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
89422024-12-21T07:54:01.272ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
89432024-12-21T07:54:01.272ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89442024-12-21T07:54:01.272ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89452024-12-21T07:54:01.272ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89462024-12-21T07:54:01.272ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89472024-12-21T07:54:01.272ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89482024-12-21T07:54:01.272ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89492024-12-21T07:54:01.272ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
89502024-12-21T07:54:01.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89512024-12-21T07:54:01.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89522024-12-21T07:54:01.282ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
89532024-12-21T07:54:01.284ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
89542024-12-21T07:54:01.284ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a3bc40a-6a42-4eef-a551-b82351e186c2", "content-length": "2", "date": "Sat, 21 Dec 2024 07:54:00 GMT"} })
89552024-12-21T07:54:01.284ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
89562024-12-21T07:54:01.284ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3daa631-2591-4650-9f99-5c47f4b554ba", "content-length": "52", "date": "Sat, 21 Dec 2024 07:54:00 GMT"} })
89572024-12-21T07:54:01.284ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
89582024-12-21T07:54:01.284ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
89592024-12-21T07:54:01.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fcb18e6e-1200-478a-aba3-b5dabb676435 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
89602024-12-21T07:54:01.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fcb18e6e-1200-478a-aba3-b5dabb676435 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
89612024-12-21T07:54:01.345ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2294eb5e-9df1-4bc2-87c4-5b6ed099109b", "content-length": "691", "date": "Sat, 21 Dec 2024 07:54:01 GMT"} })
89622024-12-21T07:54:01.345ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
89632024-12-21T07:54:01.345ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
89642024-12-21T07:54:01.345ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
89652024-12-21T07:54:01.347ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 679.798171ms iteration = 23 status = {}
89662024-12-21T07:54:01.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fcb18e6e-1200-478a-aba3-b5dabb676435 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
89672024-12-21T07:54:01.442ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "55beb4db-ed5b-4f3d-b53e-c71898fc7505", "date": "Sat, 21 Dec 2024 07:54:01 GMT"} })
89682024-12-21T07:54:01.442ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
89692024-12-21T07:54:01.442ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
89702024-12-21T07:54:01.443ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "07796df5-7bd5-4a2a-8f66-aa42e7d1e66f", "content-length": "682", "date": "Sat, 21 Dec 2024 07:54:01 GMT"} })
89712024-12-21T07:54:01.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89722024-12-21T07:54:01.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89732024-12-21T07:54:01.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89742024-12-21T07:54:01.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89752024-12-21T07:54:01.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89762024-12-21T07:54:01.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89772024-12-21T07:54:01.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89782024-12-21T07:54:01.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89792024-12-21T07:54:01.460ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 793.843028ms iteration = 23 status = {}
89802024-12-21T07:54:02.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4aa6a068-df06-4cea-93f6-94af5d5d502c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
89812024-12-21T07:54:02.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4aa6a068-df06-4cea-93f6-94af5d5d502c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
89822024-12-21T07:54:02.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4aa6a068-df06-4cea-93f6-94af5d5d502c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
89832024-12-21T07:54:03.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6cdfaec2-9b96-451e-ae13-416fd0a9d55d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
89842024-12-21T07:54:03.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6cdfaec2-9b96-451e-ae13-416fd0a9d55d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
89852024-12-21T07:54:03.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6cdfaec2-9b96-451e-ae13-416fd0a9d55d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
89862024-12-21T07:54:04.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 063d8276-5806-473d-9d51-06d8abe9aa83 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
89872024-12-21T07:54:04.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 063d8276-5806-473d-9d51-06d8abe9aa83 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
89882024-12-21T07:54:04.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2900 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 063d8276-5806-473d-9d51-06d8abe9aa83 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
89892024-12-21T07:54:04.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = e2e0aa56-8fc9-45ae-95ec-82e2b98adc37 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
89902024-12-21T07:54:04.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = e2e0aa56-8fc9-45ae-95ec-82e2b98adc37 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
89912024-12-21T07:54:04.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = e2e0aa56-8fc9-45ae-95ec-82e2b98adc37 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
89922024-12-21T07:54:04.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = eb5b7593-46a8-42b4-ba78-f5364cef52cf roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
89932024-12-21T07:54:04.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = eb5b7593-46a8-42b4-ba78-f5364cef52cf resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
89942024-12-21T07:54:04.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = eb5b7593-46a8-42b4-ba78-f5364cef52cf response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
89952024-12-21T07:54:05.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2c72565-3eeb-447e-bd77-0bc3b5bd928f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
89962024-12-21T07:54:05.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2c72565-3eeb-447e-bd77-0bc3b5bd928f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
89972024-12-21T07:54:05.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1792 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2c72565-3eeb-447e-bd77-0bc3b5bd928f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
89982024-12-21T07:54:06.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 16f3a421-11ea-4398-93a8-574d7076d16f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
89992024-12-21T07:54:06.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 16f3a421-11ea-4398-93a8-574d7076d16f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90002024-12-21T07:54:06.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 16f3a421-11ea-4398-93a8-574d7076d16f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90012024-12-21T07:54:07.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f02119a3-1b51-4447-86b5-19c9c3b69d82 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90022024-12-21T07:54:07.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f02119a3-1b51-4447-86b5-19c9c3b69d82 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90032024-12-21T07:54:07.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1907 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f02119a3-1b51-4447-86b5-19c9c3b69d82 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90042024-12-21T07:54:08.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c62bef9f-7403-45e4-aad4-956288c11019 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90052024-12-21T07:54:08.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c62bef9f-7403-45e4-aad4-956288c11019 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90062024-12-21T07:54:08.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c62bef9f-7403-45e4-aad4-956288c11019 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90072024-12-21T07:54:09.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8669ef39-942a-4fbd-b652-9f885e542f2e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90082024-12-21T07:54:09.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8669ef39-942a-4fbd-b652-9f885e542f2e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90092024-12-21T07:54:09.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8669ef39-942a-4fbd-b652-9f885e542f2e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90102024-12-21T07:54:09.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1526 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 0ee5380e-b093-4d83-a738-b41b34a83220 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
90112024-12-21T07:54:10.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 760f9101-0f95-4ff1-bad2-04b86cf210ff roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90122024-12-21T07:54:10.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 760f9101-0f95-4ff1-bad2-04b86cf210ff resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90132024-12-21T07:54:10.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 760f9101-0f95-4ff1-bad2-04b86cf210ff response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90142024-12-21T07:54:10.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
90152024-12-21T07:54:10.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
90162024-12-21T07:54:10.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90172024-12-21T07:54:10.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90182024-12-21T07:54:10.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90192024-12-21T07:54:10.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90202024-12-21T07:54:10.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90212024-12-21T07:54:10.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90222024-12-21T07:54:10.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90232024-12-21T07:54:10.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90242024-12-21T07:54:10.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90252024-12-21T07:54:10.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90262024-12-21T07:54:10.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90272024-12-21T07:54:10.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
90282024-12-21T07:54:10.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90292024-12-21T07:54:10.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90302024-12-21T07:54:10.688ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
90312024-12-21T07:54:10.688ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.183299ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
90322024-12-21T07:54:10.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90332024-12-21T07:54:10.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90342024-12-21T07:54:10.724ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.509744ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90352024-12-21T07:54:11.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7f587629-ff48-40fa-966c-4b532b7a284c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90362024-12-21T07:54:11.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7f587629-ff48-40fa-966c-4b532b7a284c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90372024-12-21T07:54:11.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7f587629-ff48-40fa-966c-4b532b7a284c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90382024-12-21T07:54:12.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 09583a56-d095-480c-98e1-4fc055489477 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90392024-12-21T07:54:12.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 09583a56-d095-480c-98e1-4fc055489477 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90402024-12-21T07:54:12.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 09583a56-d095-480c-98e1-4fc055489477 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90412024-12-21T07:54:13.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c57ca6f8-e5ac-4d2a-a373-dacd9105c93d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90422024-12-21T07:54:13.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c57ca6f8-e5ac-4d2a-a373-dacd9105c93d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90432024-12-21T07:54:13.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c57ca6f8-e5ac-4d2a-a373-dacd9105c93d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90442024-12-21T07:54:14.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b4b36ccb-d1d7-4236-833b-9dff81968835 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90452024-12-21T07:54:14.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b4b36ccb-d1d7-4236-833b-9dff81968835 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90462024-12-21T07:54:14.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b4b36ccb-d1d7-4236-833b-9dff81968835 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90472024-12-21T07:54:15.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 271edf77-6aa6-484b-835d-3082a231884c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90482024-12-21T07:54:15.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 271edf77-6aa6-484b-835d-3082a231884c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90492024-12-21T07:54:15.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 271edf77-6aa6-484b-835d-3082a231884c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90502024-12-21T07:54:16.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f7551fdf-9c47-4cee-8c85-7cfff7289c9e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90512024-12-21T07:54:16.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f7551fdf-9c47-4cee-8c85-7cfff7289c9e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90522024-12-21T07:54:16.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f7551fdf-9c47-4cee-8c85-7cfff7289c9e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90532024-12-21T07:54:17.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e5290e8d-40aa-4de6-bcb4-5938dea741d0 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90542024-12-21T07:54:17.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e5290e8d-40aa-4de6-bcb4-5938dea741d0 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90552024-12-21T07:54:17.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e5290e8d-40aa-4de6-bcb4-5938dea741d0 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90562024-12-21T07:54:18.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b6ce189d-a7aa-4111-8da3-7fd3add63b61 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90572024-12-21T07:54:18.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b6ce189d-a7aa-4111-8da3-7fd3add63b61 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90582024-12-21T07:54:18.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2777 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b6ce189d-a7aa-4111-8da3-7fd3add63b61 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90592024-12-21T07:54:19.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1039a2a3-62fe-4f8e-8e00-d62696ced459 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90602024-12-21T07:54:19.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1039a2a3-62fe-4f8e-8e00-d62696ced459 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90612024-12-21T07:54:19.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1039a2a3-62fe-4f8e-8e00-d62696ced459 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90622024-12-21T07:54:19.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1316 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 85472c82-66ac-45bb-adeb-7e9c63ef6b44 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
90632024-12-21T07:54:20.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
90642024-12-21T07:54:20.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90652024-12-21T07:54:20.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
90662024-12-21T07:54:20.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90672024-12-21T07:54:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90682024-12-21T07:54:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90692024-12-21T07:54:20.669ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90702024-12-21T07:54:20.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90712024-12-21T07:54:20.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90722024-12-21T07:54:20.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90732024-12-21T07:54:20.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90742024-12-21T07:54:20.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90752024-12-21T07:54:20.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90762024-12-21T07:54:20.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90772024-12-21T07:54:20.695ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.505044ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90782024-12-21T07:54:20.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90792024-12-21T07:54:20.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
90802024-12-21T07:54:20.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90812024-12-21T07:54:20.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90822024-12-21T07:54:20.716ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
90832024-12-21T07:54:20.716ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.338191ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
90842024-12-21T07:54:20.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 73a7a3e1-f14c-49e1-a2c0-bce61b72885e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90852024-12-21T07:54:20.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 73a7a3e1-f14c-49e1-a2c0-bce61b72885e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90862024-12-21T07:54:20.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1689 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 73a7a3e1-f14c-49e1-a2c0-bce61b72885e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90872024-12-21T07:54:21.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3ad16457-863f-485d-ae67-eaa8c7ca2f37 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90882024-12-21T07:54:21.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3ad16457-863f-485d-ae67-eaa8c7ca2f37 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90892024-12-21T07:54:21.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1845 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3ad16457-863f-485d-ae67-eaa8c7ca2f37 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90902024-12-21T07:54:22.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5ae122b1-ee7a-4ef3-8f1c-198081cb0c89 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90912024-12-21T07:54:22.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5ae122b1-ee7a-4ef3-8f1c-198081cb0c89 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90922024-12-21T07:54:22.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5ae122b1-ee7a-4ef3-8f1c-198081cb0c89 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90932024-12-21T07:54:23.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0912f655-97d4-49eb-a047-3fc58a1e73bd roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90942024-12-21T07:54:23.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0912f655-97d4-49eb-a047-3fc58a1e73bd resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90952024-12-21T07:54:23.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0912f655-97d4-49eb-a047-3fc58a1e73bd response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90962024-12-21T07:54:24.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = adb71f14-6ed5-444b-b384-748174d837d1 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90972024-12-21T07:54:24.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = adb71f14-6ed5-444b-b384-748174d837d1 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90982024-12-21T07:54:24.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = adb71f14-6ed5-444b-b384-748174d837d1 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
90992024-12-21T07:54:25.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2fbafd8a-cb94-4da4-8a9f-f10c2f74fad3 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
91002024-12-21T07:54:25.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2fbafd8a-cb94-4da4-8a9f-f10c2f74fad3 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
91012024-12-21T07:54:25.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2456 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2fbafd8a-cb94-4da4-8a9f-f10c2f74fad3 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
91022024-12-21T07:54:26.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8cd859f7-cb37-4f16-8dc5-a37b76a29cb2 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
91032024-12-21T07:54:26.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8cd859f7-cb37-4f16-8dc5-a37b76a29cb2 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
91042024-12-21T07:54:26.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8cd859f7-cb37-4f16-8dc5-a37b76a29cb2 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
91052024-12-21T07:54:27.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 524bdbca-84b1-4753-b60b-2753783d52c2 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
91062024-12-21T07:54:27.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 524bdbca-84b1-4753-b60b-2753783d52c2 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
91072024-12-21T07:54:27.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 524bdbca-84b1-4753-b60b-2753783d52c2 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
91082024-12-21T07:54:28.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9436b8bf-cb68-4fa5-a731-4f371abe1c2e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
91092024-12-21T07:54:28.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9436b8bf-cb68-4fa5-a731-4f371abe1c2e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
91102024-12-21T07:54:28.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9436b8bf-cb68-4fa5-a731-4f371abe1c2e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
91112024-12-21T07:54:29.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1287 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 4c90e90e-916b-424d-865b-bbc11fff93b3 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
91122024-12-21T07:54:29.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1b27f7a5-566a-4944-a1b5-97658bdc0c5c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
91132024-12-21T07:54:29.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1b27f7a5-566a-4944-a1b5-97658bdc0c5c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
91142024-12-21T07:54:29.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1b27f7a5-566a-4944-a1b5-97658bdc0c5c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
91152024-12-21T07:54:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
91162024-12-21T07:54:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
91172024-12-21T07:54:30.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
91182024-12-21T07:54:30.666ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
91192024-12-21T07:54:30.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91202024-12-21T07:54:30.666ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
91212024-12-21T07:54:30.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91222024-12-21T07:54:30.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91232024-12-21T07:54:30.666ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
91242024-12-21T07:54:30.666ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
91252024-12-21T07:54:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
91262024-12-21T07:54:30.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91272024-12-21T07:54:30.666ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
91282024-12-21T07:54:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91292024-12-21T07:54:30.666ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
91302024-12-21T07:54:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
91312024-12-21T07:54:30.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91322024-12-21T07:54:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
91332024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
91342024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
91352024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
91362024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
91372024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
91382024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91392024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
91402024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91412024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
91422024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
91432024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
91442024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91452024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
91462024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
91472024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91482024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
91492024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
91502024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
91512024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91522024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
91532024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91542024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91552024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91562024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
91572024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
91582024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
91592024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
91602024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
91612024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91622024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
91632024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
91642024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91652024-12-21T07:54:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91662024-12-21T07:54:30.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91672024-12-21T07:54:30.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91682024-12-21T07:54:30.670ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.724992ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
91692024-12-21T07:54:30.671ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91702024-12-21T07:54:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91712024-12-21T07:54:30.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91722024-12-21T07:54:30.673ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91732024-12-21T07:54:30.673ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91742024-12-21T07:54:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91752024-12-21T07:54:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91762024-12-21T07:54:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
91772024-12-21T07:54:30.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91782024-12-21T07:54:30.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91792024-12-21T07:54:30.675ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91802024-12-21T07:54:30.676ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 375807804 } })
91812024-12-21T07:54:30.677ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
91822024-12-21T07:54:30.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
91832024-12-21T07:54:30.677ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
91842024-12-21T07:54:30.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
91852024-12-21T07:54:30.678ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 377690896 } })
91862024-12-21T07:54:30.679ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
91872024-12-21T07:54:30.680ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91882024-12-21T07:54:30.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91892024-12-21T07:54:30.682ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1604, tv_nsec: 381331567 } })
91902024-12-21T07:54:30.682ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
91912024-12-21T07:54:30.683ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91922024-12-21T07:54:30.685ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
91932024-12-21T07:54:30.685ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91942024-12-21T07:54:30.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91952024-12-21T07:54:30.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 30.331664ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
91962024-12-21T07:54:30.703ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
91972024-12-21T07:54:30.703ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.224813ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
91982024-12-21T07:54:30.703ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91992024-12-21T07:54:30.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92002024-12-21T07:54:30.706ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92012024-12-21T07:54:30.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92022024-12-21T07:54:30.709ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92032024-12-21T07:54:30.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92042024-12-21T07:54:30.710ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92052024-12-21T07:54:30.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92062024-12-21T07:54:30.710ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92072024-12-21T07:54:30.710ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
92082024-12-21T07:54:30.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92092024-12-21T07:54:30.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92102024-12-21T07:54:30.711ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 44.47358ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
92112024-12-21T07:54:30.711ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92122024-12-21T07:54:30.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92132024-12-21T07:54:30.713ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92142024-12-21T07:54:30.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92152024-12-21T07:54:30.714ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92162024-12-21T07:54:30.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92172024-12-21T07:54:30.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92182024-12-21T07:54:30.717ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92192024-12-21T07:54:30.717ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92202024-12-21T07:54:30.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92212024-12-21T07:54:30.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92222024-12-21T07:54:30.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92232024-12-21T07:54:30.718ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92242024-12-21T07:54:30.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92252024-12-21T07:54:30.719ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92262024-12-21T07:54:30.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
92272024-12-21T07:54:30.721ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92282024-12-21T07:54:30.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92292024-12-21T07:54:30.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92302024-12-21T07:54:30.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92312024-12-21T07:54:30.723ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
92322024-12-21T07:54:30.723ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.828875ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
92332024-12-21T07:54:30.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92342024-12-21T07:54:30.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92352024-12-21T07:54:30.751ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92362024-12-21T07:54:30.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92372024-12-21T07:54:30.754ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 87.484336ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92382024-12-21T07:54:30.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92392024-12-21T07:54:30.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92402024-12-21T07:54:30.760ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92412024-12-21T07:54:30.761ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 94.36083ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
92422024-12-21T07:54:30.761ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92432024-12-21T07:54:30.761ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
92442024-12-21T07:54:30.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92452024-12-21T07:54:30.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92462024-12-21T07:54:30.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 96.20902ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
92472024-12-21T07:54:30.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
92482024-12-21T07:54:30.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92492024-12-21T07:54:30.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92502024-12-21T07:54:30.765ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.353656ms iteration = 24 status = 0
92512024-12-21T07:54:30.767ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 101.032261ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
92522024-12-21T07:54:30.768ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 101.334466ms iteration = 28 status = {"physical_disks_added":0}
92532024-12-21T07:54:30.778ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
92542024-12-21T07:54:30.778ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92552024-12-21T07:54:30.778ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "543108ad-0277-4a46-a3d7-8616e33a737c", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:30 GMT"} })
92562024-12-21T07:54:30.778ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92572024-12-21T07:54:30.780ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
92582024-12-21T07:54:30.780ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92592024-12-21T07:54:30.780ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "72a00313-6a4c-4053-bd81-3a51c9266d51", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:30 GMT"} })
92602024-12-21T07:54:30.780ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92612024-12-21T07:54:30.780ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92622024-12-21T07:54:30.782ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92632024-12-21T07:54:30.787ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
92642024-12-21T07:54:30.787ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92652024-12-21T07:54:30.787ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de4dba95-ea25-4126-b670-95035d48dce4", "content-length": "26", "date": "Sat, 21 Dec 2024 07:54:30 GMT"} })
92662024-12-21T07:54:30.787ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92672024-12-21T07:54:30.789ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
92682024-12-21T07:54:30.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92692024-12-21T07:54:30.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92702024-12-21T07:54:30.809ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92712024-12-21T07:54:30.809ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
92722024-12-21T07:54:30.809ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.355939ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
92732024-12-21T07:54:30.820ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92742024-12-21T07:54:30.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92752024-12-21T07:54:30.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92762024-12-21T07:54:30.828ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92772024-12-21T07:54:30.828ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92782024-12-21T07:54:30.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92792024-12-21T07:54:30.908ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
92802024-12-21T07:54:30.908ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "baf5b465-5f08-4921-acec-118fde0505ab", "content-length": "1", "date": "Sat, 21 Dec 2024 07:54:30 GMT"} })
92812024-12-21T07:54:30.910ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92822024-12-21T07:54:30.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92832024-12-21T07:54:30.914ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 247.179282ms iteration = 24 status = {}
92842024-12-21T07:54:30.916ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
92852024-12-21T07:54:30.916ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92862024-12-21T07:54:30.917ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f3d30bd-3166-4288-aa83-3a2e19bc0fef", "content-length": "372", "date": "Sat, 21 Dec 2024 07:54:30 GMT"} })
92872024-12-21T07:54:30.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92882024-12-21T07:54:30.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92892024-12-21T07:54:30.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92902024-12-21T07:54:30.919ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 252.40677ms iteration = 24 status = null
92912024-12-21T07:54:30.920ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92922024-12-21T07:54:30.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92932024-12-21T07:54:30.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92942024-12-21T07:54:30.964ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
92952024-12-21T07:54:30.964ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
92962024-12-21T07:54:30.964ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7910bbf2-76da-4263-95dd-3d352e5e59ed", "date": "Sat, 21 Dec 2024 07:54:30 GMT"} })
92972024-12-21T07:54:30.964ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92982024-12-21T07:54:30.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92992024-12-21T07:54:30.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93002024-12-21T07:54:30.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93012024-12-21T07:54:30.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93022024-12-21T07:54:30.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93032024-12-21T07:54:30.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 11faab46-bb4f-49fb-af61-7cf66bbcbfeb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93042024-12-21T07:54:30.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 11faab46-bb4f-49fb-af61-7cf66bbcbfeb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93052024-12-21T07:54:30.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 11faab46-bb4f-49fb-af61-7cf66bbcbfeb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93062024-12-21T07:54:30.974ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
93072024-12-21T07:54:30.974ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93082024-12-21T07:54:30.981ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1278a35c-3ef0-4c20-98f4-50f49b50575d", "date": "Sat, 21 Dec 2024 07:54:30 GMT"} })
93092024-12-21T07:54:30.983ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 317.073746ms iteration = 25 status = {}
93102024-12-21T07:54:30.988ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
93112024-12-21T07:54:30.988ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "44f82394-ac1a-47b9-988d-9faae06ba510", "content-length": "691", "date": "Sat, 21 Dec 2024 07:54:30 GMT"} })
93122024-12-21T07:54:30.988ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
93132024-12-21T07:54:30.988ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
93142024-12-21T07:54:30.988ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
93152024-12-21T07:54:30.990ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 323.800488ms iteration = 24 status = {}
93162024-12-21T07:54:31.016ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93172024-12-21T07:54:31.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93182024-12-21T07:54:31.018ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
93192024-12-21T07:54:31.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93202024-12-21T07:54:31.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93212024-12-21T07:54:31.029ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
93222024-12-21T07:54:31.030ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9c4b70c-565b-4d6f-a039-15d2138a3fae", "content-length": "134", "date": "Sat, 21 Dec 2024 07:54:30 GMT"} })
93232024-12-21T07:54:31.030ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
93242024-12-21T07:54:31.030ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
93252024-12-21T07:54:31.030ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
93262024-12-21T07:54:31.030ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
93272024-12-21T07:54:31.030ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93282024-12-21T07:54:31.030ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93292024-12-21T07:54:31.030ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93302024-12-21T07:54:31.030ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93312024-12-21T07:54:31.030ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93322024-12-21T07:54:31.030ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93332024-12-21T07:54:31.030ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
93342024-12-21T07:54:31.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93352024-12-21T07:54:31.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93362024-12-21T07:54:31.033ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
93372024-12-21T07:54:31.033ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd68490d-700f-410a-9f55-253d55cadecb", "content-length": "2", "date": "Sat, 21 Dec 2024 07:54:30 GMT"} })
93382024-12-21T07:54:31.033ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
93392024-12-21T07:54:31.033ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae57aec4-995c-439c-8c39-35dbf8293980", "content-length": "52", "date": "Sat, 21 Dec 2024 07:54:30 GMT"} })
93402024-12-21T07:54:31.033ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
93412024-12-21T07:54:31.033ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
93422024-12-21T07:54:31.132ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f5c24ff2-2f3e-414e-b461-7fc30ee0b0f0", "date": "Sat, 21 Dec 2024 07:54:30 GMT"} })
93432024-12-21T07:54:31.132ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
93442024-12-21T07:54:31.132ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
93452024-12-21T07:54:31.132ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "66f8e29c-e7f1-44da-8c00-ef2963932926", "content-length": "682", "date": "Sat, 21 Dec 2024 07:54:31 GMT"} })
93462024-12-21T07:54:31.133ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93472024-12-21T07:54:31.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93482024-12-21T07:54:31.136ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93492024-12-21T07:54:31.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93502024-12-21T07:54:31.138ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93512024-12-21T07:54:31.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93522024-12-21T07:54:31.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = b3de63eb-b619-4a19-b9c5-44aa21b56610 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
93532024-12-21T07:54:31.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = b3de63eb-b619-4a19-b9c5-44aa21b56610 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
93542024-12-21T07:54:31.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93552024-12-21T07:54:31.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93562024-12-21T07:54:31.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = b3de63eb-b619-4a19-b9c5-44aa21b56610 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
93572024-12-21T07:54:31.148ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 481.171086ms iteration = 24 status = {}
93582024-12-21T07:54:31.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 764b71c8-92cd-4f2b-8b66-2e895b430a7b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93592024-12-21T07:54:31.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 764b71c8-92cd-4f2b-8b66-2e895b430a7b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93602024-12-21T07:54:31.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 764b71c8-92cd-4f2b-8b66-2e895b430a7b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93612024-12-21T07:54:33.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2636d37d-c1bc-4c5b-a762-ea949887d993 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93622024-12-21T07:54:33.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2636d37d-c1bc-4c5b-a762-ea949887d993 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93632024-12-21T07:54:33.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2636d37d-c1bc-4c5b-a762-ea949887d993 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93642024-12-21T07:54:34.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 141334ae-1e57-45b7-a757-03a5fb7b980b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93652024-12-21T07:54:34.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 141334ae-1e57-45b7-a757-03a5fb7b980b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93662024-12-21T07:54:34.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 141334ae-1e57-45b7-a757-03a5fb7b980b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93672024-12-21T07:54:35.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3d30a616-f743-44ee-abd0-49f870eea733 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93682024-12-21T07:54:35.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3d30a616-f743-44ee-abd0-49f870eea733 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93692024-12-21T07:54:35.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3d30a616-f743-44ee-abd0-49f870eea733 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93702024-12-21T07:54:36.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4976f742-6d7b-4fcd-8fb3-e2d37b694144 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93712024-12-21T07:54:36.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4976f742-6d7b-4fcd-8fb3-e2d37b694144 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93722024-12-21T07:54:36.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4976f742-6d7b-4fcd-8fb3-e2d37b694144 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93732024-12-21T07:54:37.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0a66e46a-0214-49e5-85c7-229e7c2d4b45 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93742024-12-21T07:54:37.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0a66e46a-0214-49e5-85c7-229e7c2d4b45 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93752024-12-21T07:54:37.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0a66e46a-0214-49e5-85c7-229e7c2d4b45 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93762024-12-21T07:54:38.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c259a948-3505-49d1-8587-2a8d491c3e95 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93772024-12-21T07:54:38.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c259a948-3505-49d1-8587-2a8d491c3e95 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93782024-12-21T07:54:38.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1851 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c259a948-3505-49d1-8587-2a8d491c3e95 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93792024-12-21T07:54:39.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4099a00b-85f4-4f7e-b8d1-af5e6c3e1d77 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93802024-12-21T07:54:39.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4099a00b-85f4-4f7e-b8d1-af5e6c3e1d77 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93812024-12-21T07:54:39.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4099a00b-85f4-4f7e-b8d1-af5e6c3e1d77 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93822024-12-21T07:54:39.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1485 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 03a46a9c-1974-449a-871b-22c57fdd9143 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
93832024-12-21T07:54:40.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2bea8302-762d-4326-87a7-3c77e3a1cdc7 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93842024-12-21T07:54:40.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2bea8302-762d-4326-87a7-3c77e3a1cdc7 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93852024-12-21T07:54:40.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2bea8302-762d-4326-87a7-3c77e3a1cdc7 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
93862024-12-21T07:54:40.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
93872024-12-21T07:54:40.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
93882024-12-21T07:54:40.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93892024-12-21T07:54:40.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93902024-12-21T07:54:40.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93912024-12-21T07:54:40.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93922024-12-21T07:54:40.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93932024-12-21T07:54:40.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93942024-12-21T07:54:40.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93952024-12-21T07:54:40.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93962024-12-21T07:54:40.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93972024-12-21T07:54:40.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93982024-12-21T07:54:40.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93992024-12-21T07:54:40.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94002024-12-21T07:54:40.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.236829ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94012024-12-21T07:54:40.700ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94022024-12-21T07:54:40.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
94032024-12-21T07:54:40.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94042024-12-21T07:54:40.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94052024-12-21T07:54:40.712ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
94062024-12-21T07:54:40.712ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.762544ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
94072024-12-21T07:54:41.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eb5ec41f-4c6b-44d0-9ac6-d2dd73539826 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94082024-12-21T07:54:41.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eb5ec41f-4c6b-44d0-9ac6-d2dd73539826 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94092024-12-21T07:54:41.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eb5ec41f-4c6b-44d0-9ac6-d2dd73539826 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94102024-12-21T07:54:42.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 551ef3dd-a3b1-4716-ae5f-c59e6046622c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94112024-12-21T07:54:42.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 551ef3dd-a3b1-4716-ae5f-c59e6046622c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94122024-12-21T07:54:42.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 551ef3dd-a3b1-4716-ae5f-c59e6046622c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94132024-12-21T07:54:43.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 994dd129-2226-4fe4-ba9a-6e969025d5ad roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94142024-12-21T07:54:43.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 994dd129-2226-4fe4-ba9a-6e969025d5ad resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94152024-12-21T07:54:43.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2503 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 994dd129-2226-4fe4-ba9a-6e969025d5ad response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94162024-12-21T07:54:44.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3781a7a5-a878-409c-95be-5eb520d94242 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94172024-12-21T07:54:44.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3781a7a5-a878-409c-95be-5eb520d94242 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94182024-12-21T07:54:44.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3781a7a5-a878-409c-95be-5eb520d94242 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94192024-12-21T07:54:45.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c3ec4ca5-cc4f-4398-9d4d-adf70f3a2a52 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94202024-12-21T07:54:45.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c3ec4ca5-cc4f-4398-9d4d-adf70f3a2a52 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94212024-12-21T07:54:45.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c3ec4ca5-cc4f-4398-9d4d-adf70f3a2a52 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94222024-12-21T07:54:46.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 64269ac3-f7df-4e20-ba77-ffc5864ee012 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94232024-12-21T07:54:46.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 64269ac3-f7df-4e20-ba77-ffc5864ee012 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94242024-12-21T07:54:46.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 64269ac3-f7df-4e20-ba77-ffc5864ee012 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94252024-12-21T07:54:47.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5ca93cda-0863-49cb-84f8-41874bf3f072 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94262024-12-21T07:54:47.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5ca93cda-0863-49cb-84f8-41874bf3f072 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94272024-12-21T07:54:47.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5ca93cda-0863-49cb-84f8-41874bf3f072 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94282024-12-21T07:54:48.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b04db3e1-130b-434a-bf66-1540009510cf roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94292024-12-21T07:54:48.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b04db3e1-130b-434a-bf66-1540009510cf resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94302024-12-21T07:54:48.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b04db3e1-130b-434a-bf66-1540009510cf response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94312024-12-21T07:54:49.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cdbbc92d-e3f0-451d-8535-7e3aace3d520 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94322024-12-21T07:54:49.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cdbbc92d-e3f0-451d-8535-7e3aace3d520 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94332024-12-21T07:54:49.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cdbbc92d-e3f0-451d-8535-7e3aace3d520 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94342024-12-21T07:54:49.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = ad132c76-6b08-449f-8042-8baa9c518fab roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
94352024-12-21T07:54:49.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = ad132c76-6b08-449f-8042-8baa9c518fab resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
94362024-12-21T07:54:49.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = ad132c76-6b08-449f-8042-8baa9c518fab response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
94372024-12-21T07:54:49.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 5b860709-c608-45ca-a578-a32edaadbf24 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
94382024-12-21T07:54:49.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 5b860709-c608-45ca-a578-a32edaadbf24 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
94392024-12-21T07:54:49.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 5b860709-c608-45ca-a578-a32edaadbf24 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
94402024-12-21T07:54:49.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1328 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 4c86ad35-35f4-431a-af0f-b371825b6247 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
94412024-12-21T07:54:50.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 77bc2059-0748-4c50-b06b-d3de2d1c0f36 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94422024-12-21T07:54:50.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 77bc2059-0748-4c50-b06b-d3de2d1c0f36 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94432024-12-21T07:54:50.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 77bc2059-0748-4c50-b06b-d3de2d1c0f36 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94442024-12-21T07:54:50.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
94452024-12-21T07:54:50.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94462024-12-21T07:54:50.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
94472024-12-21T07:54:50.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94482024-12-21T07:54:50.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94492024-12-21T07:54:50.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94502024-12-21T07:54:50.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94512024-12-21T07:54:50.669ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94522024-12-21T07:54:50.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94532024-12-21T07:54:50.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.129619ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94542024-12-21T07:54:50.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94552024-12-21T07:54:50.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94562024-12-21T07:54:50.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94572024-12-21T07:54:50.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94582024-12-21T07:54:50.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94592024-12-21T07:54:50.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94602024-12-21T07:54:50.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
94612024-12-21T07:54:50.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94622024-12-21T07:54:50.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94632024-12-21T07:54:50.687ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
94642024-12-21T07:54:50.687ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.324369ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
94652024-12-21T07:54:51.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9002cf91-27ef-4fd9-a4f7-3274f9205314 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94662024-12-21T07:54:51.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9002cf91-27ef-4fd9-a4f7-3274f9205314 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94672024-12-21T07:54:51.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9002cf91-27ef-4fd9-a4f7-3274f9205314 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94682024-12-21T07:54:52.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 15df0803-de71-4ce4-b630-72541fd7ab2b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94692024-12-21T07:54:52.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 15df0803-de71-4ce4-b630-72541fd7ab2b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94702024-12-21T07:54:52.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 15df0803-de71-4ce4-b630-72541fd7ab2b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94712024-12-21T07:54:53.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6e99589e-ac27-4a46-b8ce-dc0d9a9d19ac roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94722024-12-21T07:54:53.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6e99589e-ac27-4a46-b8ce-dc0d9a9d19ac resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94732024-12-21T07:54:53.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6e99589e-ac27-4a46-b8ce-dc0d9a9d19ac response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94742024-12-21T07:54:54.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fe23ffff-ea6f-43ad-9065-8d048ea3a79a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94752024-12-21T07:54:54.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fe23ffff-ea6f-43ad-9065-8d048ea3a79a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94762024-12-21T07:54:54.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = fe23ffff-ea6f-43ad-9065-8d048ea3a79a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94772024-12-21T07:54:55.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 32443ef8-9fdf-4f7a-a5e8-b32c9d7e21e9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
94782024-12-21T07:54:55.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 32443ef8-9fdf-4f7a-a5e8-b32c9d7e21e9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
94792024-12-21T07:54:55.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3907 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 32443ef8-9fdf-4f7a-a5e8-b32c9d7e21e9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
94802024-12-21T07:54:55.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 1238f7ad-8031-4fd8-a4bc-b054aaf41ec7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
94812024-12-21T07:54:55.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 1238f7ad-8031-4fd8-a4bc-b054aaf41ec7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
94822024-12-21T07:54:55.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 1238f7ad-8031-4fd8-a4bc-b054aaf41ec7 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
94832024-12-21T07:54:55.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a5f92886-4d28-444e-a2a6-e43c41bf897b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94842024-12-21T07:54:55.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a5f92886-4d28-444e-a2a6-e43c41bf897b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94852024-12-21T07:54:55.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a5f92886-4d28-444e-a2a6-e43c41bf897b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94862024-12-21T07:54:56.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5f182b7e-033b-4272-90c3-5d82ec3e1a2b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94872024-12-21T07:54:56.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5f182b7e-033b-4272-90c3-5d82ec3e1a2b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94882024-12-21T07:54:56.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5f182b7e-033b-4272-90c3-5d82ec3e1a2b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94892024-12-21T07:54:57.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 23ca3439-15cf-497c-8519-b435f9138c1d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94902024-12-21T07:54:57.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 23ca3439-15cf-497c-8519-b435f9138c1d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94912024-12-21T07:54:57.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 23ca3439-15cf-497c-8519-b435f9138c1d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94922024-12-21T07:54:58.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f2acb284-b83a-4cf1-81c1-419be2a2bb3e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94932024-12-21T07:54:58.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f2acb284-b83a-4cf1-81c1-419be2a2bb3e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94942024-12-21T07:54:58.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f2acb284-b83a-4cf1-81c1-419be2a2bb3e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94952024-12-21T07:54:59.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d4749341-2ed8-4894-8036-d05d4b71b392 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94962024-12-21T07:54:59.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d4749341-2ed8-4894-8036-d05d4b71b392 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94972024-12-21T07:54:59.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d4749341-2ed8-4894-8036-d05d4b71b392 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
94982024-12-21T07:54:59.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1403 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = a120d361-4385-4835-a1a2-1f011c2d7929 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
94992024-12-21T07:55:00.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8d5bf85-cd33-4c0a-87c7-c09fc27a75eb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
95002024-12-21T07:55:00.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8d5bf85-cd33-4c0a-87c7-c09fc27a75eb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
95012024-12-21T07:55:00.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8d5bf85-cd33-4c0a-87c7-c09fc27a75eb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
95022024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
95032024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
95042024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
95052024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
95062024-12-21T07:55:00.667ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
95072024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95082024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
95092024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
95102024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
95112024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
95122024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
95132024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
95142024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
95152024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95162024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
95172024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
95182024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
95192024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
95202024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
95212024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95222024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
95232024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
95242024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95252024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
95262024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
95272024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
95282024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
95292024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95302024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
95312024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
95322024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95332024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
95342024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95352024-12-21T07:55:00.667ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:45:00.667528542 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
95362024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
95372024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
95382024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
95392024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
95402024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
95412024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95422024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
95432024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
95442024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
95452024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
95462024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
95472024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
95482024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
95492024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95502024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
95512024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
95522024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95532024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95542024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
95552024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
95562024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
95572024-12-21T07:55:00.667ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b
95582024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
95592024-12-21T07:55:00.667ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
95602024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.52\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b"}
95612024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
95622024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
95632024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
95642024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
95652024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
95662024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95672024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
95682024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
95692024-12-21T07:55:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
95702024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
95712024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95722024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95732024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95742024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
95752024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
95762024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
95772024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95782024-12-21T07:55:00.668ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dd95bbd-e009-486c-8c96-451a6e195a49.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1634, tv_nsec: 366919549 } })
95792024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
95802024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95812024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
95822024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95832024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95842024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
95852024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
95862024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
95872024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95882024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
95892024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
95902024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
95912024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95922024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
95932024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
95942024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
95952024-12-21T07:55:00.668ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bfae345-1659-4377-bca9-c55abec2aeb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7c426166-4f75-4a87-b9ac-c0d590aea49b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1634, tv_nsec: 367051141 } })
95962024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
95972024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
95982024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
95992024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96002024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96012024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
96022024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.270471ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
96032024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
96042024-12-21T07:55:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.466414ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
96052024-12-21T07:55:00.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96062024-12-21T07:55:00.670ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96072024-12-21T07:55:00.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96082024-12-21T07:55:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96092024-12-21T07:55:00.671ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.17238ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
96102024-12-21T07:55:00.672ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
96112024-12-21T07:55:00.672ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96122024-12-21T07:55:00.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96132024-12-21T07:55:00.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
96142024-12-21T07:55:00.672ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96152024-12-21T07:55:00.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96162024-12-21T07:55:00.674ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96172024-12-21T07:55:00.674ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96182024-12-21T07:55:00.676ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.844118ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
96192024-12-21T07:55:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
96202024-12-21T07:55:00.676ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96212024-12-21T07:55:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96222024-12-21T07:55:00.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
96232024-12-21T07:55:00.678ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96242024-12-21T07:55:00.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96252024-12-21T07:55:00.680ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96262024-12-21T07:55:00.681ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96272024-12-21T07:55:00.681ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:45:00.667528542 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
96282024-12-21T07:55:00.681ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.099885ms iteration = 13 status = {"expiration":"2024-12-21T07:45:00.667528542Z","pruned":[]}
96292024-12-21T07:55:00.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96302024-12-21T07:55:00.682ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96312024-12-21T07:55:00.682ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1634, tv_nsec: 381422930 } })
96322024-12-21T07:55:00.682ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
96332024-12-21T07:55:00.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96342024-12-21T07:55:00.684ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96352024-12-21T07:55:00.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96362024-12-21T07:55:00.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
96372024-12-21T07:55:00.684ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96382024-12-21T07:55:00.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96392024-12-21T07:55:00.685ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96402024-12-21T07:55:00.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
96412024-12-21T07:55:00.687ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96422024-12-21T07:55:00.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96432024-12-21T07:55:00.687ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
96442024-12-21T07:55:00.687ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
96452024-12-21T07:55:00.687ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.189576ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
96462024-12-21T07:55:00.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96472024-12-21T07:55:00.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96482024-12-21T07:55:00.689ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1634, tv_nsec: 388502948 } })
96492024-12-21T07:55:00.689ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96502024-12-21T07:55:00.690ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
96512024-12-21T07:55:00.690ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96522024-12-21T07:55:00.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
96532024-12-21T07:55:00.692ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96542024-12-21T07:55:00.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96552024-12-21T07:55:00.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
96562024-12-21T07:55:00.692ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96572024-12-21T07:55:00.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96582024-12-21T07:55:00.694ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96592024-12-21T07:55:00.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
96602024-12-21T07:55:00.696ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96612024-12-21T07:55:00.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96622024-12-21T07:55:00.696ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96632024-12-21T07:55:00.697ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96642024-12-21T07:55:00.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
96652024-12-21T07:55:00.698ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96662024-12-21T07:55:00.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96672024-12-21T07:55:00.699ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96682024-12-21T07:55:00.699ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 32.152085ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
96692024-12-21T07:55:00.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
96702024-12-21T07:55:00.701ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96712024-12-21T07:55:00.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96722024-12-21T07:55:00.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
96732024-12-21T07:55:00.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96742024-12-21T07:55:00.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96752024-12-21T07:55:00.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.358198ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96762024-12-21T07:55:00.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96772024-12-21T07:55:00.706ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
96782024-12-21T07:55:00.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96792024-12-21T07:55:00.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96802024-12-21T07:55:00.707ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96812024-12-21T07:55:00.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96822024-12-21T07:55:00.707ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96832024-12-21T07:55:00.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96842024-12-21T07:55:00.708ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96852024-12-21T07:55:00.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96862024-12-21T07:55:00.709ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1634, tv_nsec: 408331278 } })
96872024-12-21T07:55:00.709ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96882024-12-21T07:55:00.709ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
96892024-12-21T07:55:00.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96902024-12-21T07:55:00.711ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 44.625243ms iteration = 6 status = {"nsuccess":5}
96912024-12-21T07:55:00.724ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.06289ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
96922024-12-21T07:55:00.727ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96932024-12-21T07:55:00.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96942024-12-21T07:55:00.730ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96952024-12-21T07:55:00.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
96962024-12-21T07:55:00.733ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96972024-12-21T07:55:00.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96982024-12-21T07:55:00.737ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96992024-12-21T07:55:00.737ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97002024-12-21T07:55:00.737ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97012024-12-21T07:55:00.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97022024-12-21T07:55:00.740ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97032024-12-21T07:55:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97042024-12-21T07:55:00.750ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97052024-12-21T07:55:00.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97062024-12-21T07:55:00.751ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
97072024-12-21T07:55:00.751ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
97082024-12-21T07:55:00.751ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
97092024-12-21T07:55:00.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97102024-12-21T07:55:00.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97112024-12-21T07:55:00.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97122024-12-21T07:55:00.753ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97132024-12-21T07:55:00.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97142024-12-21T07:55:00.755ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 87.654199ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97152024-12-21T07:55:00.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97162024-12-21T07:55:00.755ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97172024-12-21T07:55:00.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97182024-12-21T07:55:00.756ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97192024-12-21T07:55:00.756ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
97202024-12-21T07:55:00.756ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
97212024-12-21T07:55:00.757ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 89.286516ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
97222024-12-21T07:55:00.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97232024-12-21T07:55:00.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97242024-12-21T07:55:00.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97252024-12-21T07:55:00.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97262024-12-21T07:55:00.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97272024-12-21T07:55:00.761ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
97282024-12-21T07:55:00.761ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
97292024-12-21T07:55:00.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97302024-12-21T07:55:00.768ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97312024-12-21T07:55:00.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97322024-12-21T07:55:00.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
97332024-12-21T07:55:00.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97342024-12-21T07:55:00.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97352024-12-21T07:55:00.770ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 103.287909ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97362024-12-21T07:55:00.772ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
97372024-12-21T07:55:00.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
97382024-12-21T07:55:00.802ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
97392024-12-21T07:55:00.802ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 0 version = 2
97402024-12-21T07:55:00.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97412024-12-21T07:55:00.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97422024-12-21T07:55:00.806ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97432024-12-21T07:55:00.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97442024-12-21T07:55:00.807ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97452024-12-21T07:55:00.807ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
97462024-12-21T07:55:00.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97472024-12-21T07:55:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97482024-12-21T07:55:00.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
97492024-12-21T07:55:00.810ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97502024-12-21T07:55:00.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97512024-12-21T07:55:00.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
97522024-12-21T07:55:00.811ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97532024-12-21T07:55:00.811ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 143.885894ms iteration = 29 status = {"physical_disks_added":0}
97542024-12-21T07:55:00.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97552024-12-21T07:55:00.814ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
97562024-12-21T07:55:00.814ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 146.691091ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
97572024-12-21T07:55:00.816ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
97582024-12-21T07:55:00.816ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97592024-12-21T07:55:00.817ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f25f3eff-f8dc-4ab5-bd95-a6108f9396e1", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:00 GMT"} })
97602024-12-21T07:55:00.817ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97612024-12-21T07:55:00.817ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
97622024-12-21T07:55:00.817ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
97632024-12-21T07:55:00.817ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
97642024-12-21T07:55:00.817ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97652024-12-21T07:55:00.817ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97662024-12-21T07:55:00.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97672024-12-21T07:55:00.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97682024-12-21T07:55:00.821ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97692024-12-21T07:55:00.833ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
97702024-12-21T07:55:00.833ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97712024-12-21T07:55:00.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 166.735614ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
97722024-12-21T07:55:00.834ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3355b3bf-d2c1-49cb-934a-19086fb8a253", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:00 GMT"} })
97732024-12-21T07:55:00.834ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97742024-12-21T07:55:00.836ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97752024-12-21T07:55:00.887ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
97762024-12-21T07:55:00.887ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97772024-12-21T07:55:00.887ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6de18e34-28ad-4782-9830-659c6d06b752", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:00 GMT"} })
97782024-12-21T07:55:00.888ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97792024-12-21T07:55:00.890ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
97802024-12-21T07:55:00.924ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
97812024-12-21T07:55:00.924ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 256.694811ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
97822024-12-21T07:55:00.965ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
97832024-12-21T07:55:00.965ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1f02e3df-3f1f-43e4-8ba5-5b8607057624", "date": "Sat, 21 Dec 2024 07:55:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
97842024-12-21T07:55:00.965ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
97852024-12-21T07:55:00.967ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2da93456-67bc-4ed7-87a9-5ab474d5d8da", "date": "Sat, 21 Dec 2024 07:55:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
97862024-12-21T07:55:00.967ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
97872024-12-21T07:55:00.969ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
97882024-12-21T07:55:00.969ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 301.834642ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
97892024-12-21T07:55:00.972ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
97902024-12-21T07:55:01.034ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850/state
97912024-12-21T07:55:01.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97922024-12-21T07:55:01.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97932024-12-21T07:55:01.039ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97942024-12-21T07:55:01.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97952024-12-21T07:55:01.079ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
97962024-12-21T07:55:01.079ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "938b63b5-e9b6-487e-b6e6-2ae981df8f22", "content-length": "1", "date": "Sat, 21 Dec 2024 07:55:00 GMT"} })
97972024-12-21T07:55:01.080ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
97982024-12-21T07:55:01.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
97992024-12-21T07:55:01.081ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
98002024-12-21T07:55:01.081ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98012024-12-21T07:55:01.082ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3346eb57-30d9-4a93-8a47-0c67319f908c", "content-length": "585", "date": "Sat, 21 Dec 2024 07:55:01 GMT"} })
98022024-12-21T07:55:01.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98032024-12-21T07:55:01.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98042024-12-21T07:55:01.084ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 417.339294ms iteration = 25 status = 0
98052024-12-21T07:55:01.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98062024-12-21T07:55:01.086ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 1 version = 2
98072024-12-21T07:55:01.086ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
98082024-12-21T07:55:01.086ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:43:41.075205 UTC dns_group = external generation = 2
98092024-12-21T07:55:01.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 419.114993ms iteration = 14 status = {"generation":2}
98102024-12-21T07:55:01.087ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 419.474819ms iteration = 25 status = null
98112024-12-21T07:55:01.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98122024-12-21T07:55:01.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98132024-12-21T07:55:01.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98142024-12-21T07:55:01.105ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 438.320593ms iteration = 25 status = {}
98152024-12-21T07:55:01.108ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
98162024-12-21T07:55:01.108ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "00076943-881b-499f-b06c-61114c8d9882", "date": "Sat, 21 Dec 2024 07:55:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
98172024-12-21T07:55:01.108ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
98182024-12-21T07:55:01.110ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "eaea4faa-71c2-47f2-9651-b0ba05b8d9f9", "date": "Sat, 21 Dec 2024 07:55:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
98192024-12-21T07:55:01.110ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
98202024-12-21T07:55:01.112ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ddba0e02-5102-4f44-ae53-614ea6beb0cd", "date": "Sat, 21 Dec 2024 07:55:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
98212024-12-21T07:55:01.112ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
98222024-12-21T07:55:01.114ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
98232024-12-21T07:55:01.114ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 446.884356ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
98242024-12-21T07:55:01.122ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98252024-12-21T07:55:01.122ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98262024-12-21T07:55:01.122ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 455.264085ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98272024-12-21T07:55:01.126ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98282024-12-21T07:55:01.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98292024-12-21T07:55:01.128ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98302024-12-21T07:55:01.129ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
98312024-12-21T07:55:01.129ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98322024-12-21T07:55:01.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98332024-12-21T07:55:01.133ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
98342024-12-21T07:55:01.133ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
98352024-12-21T07:55:01.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98362024-12-21T07:55:01.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98372024-12-21T07:55:01.141ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {7531d270-453f-488d-a6ea-cbbd8f6fea82: {10.151.2.175: {a26a91b6-4a41-45df-b044-cd3728d02b93}, 10.151.2.176: {a26a91b6-4a41-45df-b044-cd3728d02b93}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
98382024-12-21T07:55:01.141ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
98392024-12-21T07:55:01.141ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1de7de45-3af1-4d7c-a46b-c43e3b8ee89e", "date": "Sat, 21 Dec 2024 07:55:01 GMT"} })
98402024-12-21T07:55:01.141ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98412024-12-21T07:55:01.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98422024-12-21T07:55:01.144ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98432024-12-21T07:55:01.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98442024-12-21T07:55:01.148ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98452024-12-21T07:55:01.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98462024-12-21T07:55:01.151ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98472024-12-21T07:55:01.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98482024-12-21T07:55:01.153ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98492024-12-21T07:55:01.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98502024-12-21T07:55:01.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98512024-12-21T07:55:01.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98522024-12-21T07:55:01.160ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
98532024-12-21T07:55:01.160ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
98542024-12-21T07:55:01.160ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98552024-12-21T07:55:01.160ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:42:50.264108Z, time_modified: 2024-12-21T07:42:50.264108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
98562024-12-21T07:55:01.160ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 492.750349ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]}},"default_endpoint":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
98572024-12-21T07:55:01.160ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ff8b1c6e-8b66-46c9-9afd-d79353b31405", "date": "Sat, 21 Dec 2024 07:55:01 GMT"} })
98582024-12-21T07:55:01.161ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98592024-12-21T07:55:01.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98602024-12-21T07:55:01.162ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 495.576006ms iteration = 26 status = {}
98612024-12-21T07:55:01.163ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
98622024-12-21T07:55:01.163ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98632024-12-21T07:55:01.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98642024-12-21T07:55:01.164ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98652024-12-21T07:55:01.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98662024-12-21T07:55:01.167ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98672024-12-21T07:55:01.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98682024-12-21T07:55:01.172ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
98692024-12-21T07:55:01.172ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
98702024-12-21T07:55:01.172ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:43:39.444085 UTC dns_group = internal generation = 1
98712024-12-21T07:55:01.172ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 504.8549ms iteration = 14 status = {"generation":1}
98722024-12-21T07:55:01.177ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
98732024-12-21T07:55:01.177ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "238c3496-c871-4f3c-bf2d-1ad4d8f89236", "content-length": "134", "date": "Sat, 21 Dec 2024 07:55:00 GMT"} })
98742024-12-21T07:55:01.177ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
98752024-12-21T07:55:01.177ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
98762024-12-21T07:55:01.178ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
98772024-12-21T07:55:01.178ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
98782024-12-21T07:55:01.178ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98792024-12-21T07:55:01.178ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98802024-12-21T07:55:01.178ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98812024-12-21T07:55:01.178ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98822024-12-21T07:55:01.178ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98832024-12-21T07:55:01.178ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98842024-12-21T07:55:01.178ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
98852024-12-21T07:55:01.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98862024-12-21T07:55:01.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98872024-12-21T07:55:01.181ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
98882024-12-21T07:55:01.181ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "57f47246-a46f-4839-96ff-c7ee2c8081f9", "content-length": "2", "date": "Sat, 21 Dec 2024 07:55:00 GMT"} })
98892024-12-21T07:55:01.181ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
98902024-12-21T07:55:01.181ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f36522f-5809-4892-817f-6fcad72e94ff", "content-length": "52", "date": "Sat, 21 Dec 2024 07:55:00 GMT"} })
98912024-12-21T07:55:01.181ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
98922024-12-21T07:55:01.181ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
98932024-12-21T07:55:01.188ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98942024-12-21T07:55:01.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98952024-12-21T07:55:01.190ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98962024-12-21T07:55:01.192ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98972024-12-21T07:55:01.192ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98982024-12-21T07:55:01.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98992024-12-21T07:55:01.220ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99002024-12-21T07:55:01.222ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99012024-12-21T07:55:01.222ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99022024-12-21T07:55:01.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99032024-12-21T07:55:01.257ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99042024-12-21T07:55:01.280ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "de2b83d6-ff49-499a-90a0-cd9f8647f88a", "date": "Sat, 21 Dec 2024 07:55:01 GMT"} })
99052024-12-21T07:55:01.280ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
99062024-12-21T07:55:01.280ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99072024-12-21T07:55:01.280ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1de2743-35cf-4e4b-8741-acaef6bd071d", "content-length": "811", "date": "Sat, 21 Dec 2024 07:55:01 GMT"} })
99082024-12-21T07:55:01.280ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(10875858) }} sled = sock
99092024-12-21T07:55:01.280ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
99102024-12-21T07:55:01.280ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
99112024-12-21T07:55:01.280ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8dcd3145-1c6f-4ebc-816a-205688efbeae", "content-length": "682", "date": "Sat, 21 Dec 2024 07:55:01 GMT"} })
99122024-12-21T07:55:01.280ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99132024-12-21T07:55:01.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99142024-12-21T07:55:01.283ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 615.838097ms iteration = 25 status = {}
99152024-12-21T07:55:01.285ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99162024-12-21T07:55:01.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99172024-12-21T07:55:01.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99182024-12-21T07:55:01.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99192024-12-21T07:55:01.290ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99202024-12-21T07:55:01.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99212024-12-21T07:55:01.298ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 630.789305ms iteration = 25 status = {}
99222024-12-21T07:55:01.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = db7f5e5d-628c-4406-ae79-5a9c124e27ac roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99232024-12-21T07:55:01.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = db7f5e5d-628c-4406-ae79-5a9c124e27ac resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99242024-12-21T07:55:01.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2702 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = db7f5e5d-628c-4406-ae79-5a9c124e27ac response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99252024-12-21T07:55:02.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 778ef29c-973d-4c85-b93e-a8b42904cf7d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99262024-12-21T07:55:02.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 778ef29c-973d-4c85-b93e-a8b42904cf7d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99272024-12-21T07:55:02.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2651 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 778ef29c-973d-4c85-b93e-a8b42904cf7d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99282024-12-21T07:55:02.836ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "b984b4c9-7461-4b05-a92f-30462b8ad13f", "content-length": "131", "date": "Sat, 21 Dec 2024 07:55:02 GMT"} })
99292024-12-21T07:55:02.836ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T07:54:54.929444068Z }, migration_in: None, migration_out: None } vmm_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
99302024-12-21T07:55:02.836ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2077 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 vmm_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T07:54:54.929444068Z }
99312024-12-21T07:55:02.836ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 roles = RoleSet { roles: {} } sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 vmm_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
99322024-12-21T07:55:02.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 resource = Database result = Ok(()) sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 vmm_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
99332024-12-21T07:55:02.844ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 07343ed7-2e6a-43aa-a43a-476bf4446019 uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T07:55:02.836857407Z }
99342024-12-21T07:55:02.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 07343ed7-2e6a-43aa-a43a-476bf4446019 roles = RoleSet { roles: {} } uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
99352024-12-21T07:55:02.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 07343ed7-2e6a-43aa-a43a-476bf4446019 resource = Database result = Ok(()) uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
99362024-12-21T07:55:02.873ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:48609
99372024-12-21T07:55:02.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:48609 req_id = 088dacba-b93e-4e10-b19d-7eecb6606827 roles = RoleSet { roles: {} } uri = /metrics/producers
99382024-12-21T07:55:02.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:48609 req_id = 088dacba-b93e-4e10-b19d-7eecb6606827 resource = Database result = Ok(()) uri = /metrics/producers
99392024-12-21T07:55:02.874ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
99402024-12-21T07:55:02.875ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 2.208520657s iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
99412024-12-21T07:55:02.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49720 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 07343ed7-2e6a-43aa-a43a-476bf4446019 response_code = 204 uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
99422024-12-21T07:55:02.887ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3f3333f1-f3bb-4454-82e5-c5f3abdc4429 uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T07:55:02.887179564Z }
99432024-12-21T07:55:02.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3f3333f1-f3bb-4454-82e5-c5f3abdc4429 roles = RoleSet { roles: {} } uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
99442024-12-21T07:55:02.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3f3333f1-f3bb-4454-82e5-c5f3abdc4429 resource = Database result = Ok(()) uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
99452024-12-21T07:55:02.911ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = d05e2a1f-945e-4e85-9195-e6992ffaf129
99462024-12-21T07:55:02.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37841 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:48609 req_id = 088dacba-b93e-4e10-b19d-7eecb6606827 response_code = 201 uri = /metrics/producers
99472024-12-21T07:55:02.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33165 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3f3333f1-f3bb-4454-82e5-c5f3abdc4429 response_code = 204 uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
99482024-12-21T07:55:03.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1f75900a-633a-4b20-94d3-53fb24b9f081 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99492024-12-21T07:55:03.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1f75900a-633a-4b20-94d3-53fb24b9f081 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99502024-12-21T07:55:03.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1f75900a-633a-4b20-94d3-53fb24b9f081 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99512024-12-21T07:55:04.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0a84a826-47cd-40db-ac36-1f382c2543b6 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99522024-12-21T07:55:04.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0a84a826-47cd-40db-ac36-1f382c2543b6 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99532024-12-21T07:55:04.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0a84a826-47cd-40db-ac36-1f382c2543b6 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99542024-12-21T07:55:05.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 67370ca3-de49-40e4-9bae-9f3b3799154d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99552024-12-21T07:55:05.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 67370ca3-de49-40e4-9bae-9f3b3799154d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99562024-12-21T07:55:05.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 67370ca3-de49-40e4-9bae-9f3b3799154d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99572024-12-21T07:55:06.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 95547efb-4b5c-4c64-8131-cfa5584df801 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99582024-12-21T07:55:06.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 95547efb-4b5c-4c64-8131-cfa5584df801 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99592024-12-21T07:55:06.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 95547efb-4b5c-4c64-8131-cfa5584df801 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99602024-12-21T07:55:07.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5538fca0-d367-4852-9c9d-f84a69d87640 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99612024-12-21T07:55:07.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5538fca0-d367-4852-9c9d-f84a69d87640 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99622024-12-21T07:55:07.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5538fca0-d367-4852-9c9d-f84a69d87640 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99632024-12-21T07:55:08.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dfcce2a2-4f14-4949-84fc-052712acf5ea roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99642024-12-21T07:55:08.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dfcce2a2-4f14-4949-84fc-052712acf5ea resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99652024-12-21T07:55:08.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dfcce2a2-4f14-4949-84fc-052712acf5ea response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99662024-12-21T07:55:09.749ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6477 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 1b4f7fd4-bb0c-458d-89db-4691c78993a5 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
99672024-12-21T07:55:09.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 01808e59-7767-4c79-a2c2-7589cc80ec44 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99682024-12-21T07:55:09.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 01808e59-7767-4c79-a2c2-7589cc80ec44 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99692024-12-21T07:55:09.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 01808e59-7767-4c79-a2c2-7589cc80ec44 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99702024-12-21T07:55:10.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
99712024-12-21T07:55:10.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
99722024-12-21T07:55:10.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99732024-12-21T07:55:10.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99742024-12-21T07:55:10.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99752024-12-21T07:55:10.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99762024-12-21T07:55:10.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99772024-12-21T07:55:10.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99782024-12-21T07:55:10.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99792024-12-21T07:55:10.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99802024-12-21T07:55:10.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99812024-12-21T07:55:10.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99822024-12-21T07:55:10.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99832024-12-21T07:55:10.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
99842024-12-21T07:55:10.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99852024-12-21T07:55:10.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99862024-12-21T07:55:10.690ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
99872024-12-21T07:55:10.690ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.639674ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
99882024-12-21T07:55:10.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99892024-12-21T07:55:10.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99902024-12-21T07:55:10.724ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.446786ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99912024-12-21T07:55:10.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7e4d5977-61ba-4b6c-ac32-94278368a1e6 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99922024-12-21T07:55:10.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7e4d5977-61ba-4b6c-ac32-94278368a1e6 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99932024-12-21T07:55:10.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7e4d5977-61ba-4b6c-ac32-94278368a1e6 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99942024-12-21T07:55:11.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = facd73a5-5e9f-445d-97bc-9cb7333dd6d6 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99952024-12-21T07:55:11.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = facd73a5-5e9f-445d-97bc-9cb7333dd6d6 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99962024-12-21T07:55:11.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1694 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = facd73a5-5e9f-445d-97bc-9cb7333dd6d6 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
99972024-12-21T07:55:12.533ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0595dc19-c12f-4b24-9e6c-bfeebc7d1a87 uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T07:55:12.533311304Z }
99982024-12-21T07:55:12.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0595dc19-c12f-4b24-9e6c-bfeebc7d1a87 roles = RoleSet { roles: {} } uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
99992024-12-21T07:55:12.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0595dc19-c12f-4b24-9e6c-bfeebc7d1a87 resource = Database result = Ok(()) uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100002024-12-21T07:55:12.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12081 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0595dc19-c12f-4b24-9e6c-bfeebc7d1a87 response_code = 204 uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100012024-12-21T07:55:12.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f6814250-56c6-4333-b31a-1f473dc860b0 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
100022024-12-21T07:55:12.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f6814250-56c6-4333-b31a-1f473dc860b0 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
100032024-12-21T07:55:12.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f6814250-56c6-4333-b31a-1f473dc860b0 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
100042024-12-21T07:55:13.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = f88bb5cd-d9f2-466a-bbbd-50dbd25b7ed0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
100052024-12-21T07:55:13.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = f88bb5cd-d9f2-466a-bbbd-50dbd25b7ed0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
100062024-12-21T07:55:13.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6782 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = f88bb5cd-d9f2-466a-bbbd-50dbd25b7ed0 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
100072024-12-21T07:55:13.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 3f54a881-5bd3-43ee-9cec-382f266fc3e4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
100082024-12-21T07:55:13.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 3f54a881-5bd3-43ee-9cec-382f266fc3e4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
100092024-12-21T07:55:13.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2786 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 3f54a881-5bd3-43ee-9cec-382f266fc3e4 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
100102024-12-21T07:55:13.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 17653ed8-3758-40d6-abc7-48784709d2d5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
100112024-12-21T07:55:13.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 17653ed8-3758-40d6-abc7-48784709d2d5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
100122024-12-21T07:55:13.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1751 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 17653ed8-3758-40d6-abc7-48784709d2d5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
100132024-12-21T07:55:14.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = b119fc9b-2c28-4ea6-ad2e-b7d096377a0c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
100142024-12-21T07:55:14.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = b119fc9b-2c28-4ea6-ad2e-b7d096377a0c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
100152024-12-21T07:55:14.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7815 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = b119fc9b-2c28-4ea6-ad2e-b7d096377a0c response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
100162024-12-21T07:55:14.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 06c182cc-94a2-4324-9ef0-daf0f9383787 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
100172024-12-21T07:55:14.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 06c182cc-94a2-4324-9ef0-daf0f9383787 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
100182024-12-21T07:55:14.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 06c182cc-94a2-4324-9ef0-daf0f9383787 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
100192024-12-21T07:55:14.981ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T07:55:14.980852808Z }
100202024-12-21T07:55:14.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa roles = RoleSet { roles: {} } uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100212024-12-21T07:55:14.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa resource = Database result = Ok(()) uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100222024-12-21T07:55:14.992ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850 vmm_needs_update = true
100232024-12-21T07:55:14.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa roles = RoleSet { roles: {} } uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100242024-12-21T07:55:14.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa resource = Database result = Ok(()) uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100252024-12-21T07:55:14.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa roles = RoleSet { roles: {} } uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100262024-12-21T07:55:14.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa resource = Database result = Ok(()) uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100272024-12-21T07:55:14.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa roles = RoleSet { roles: {} } uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100282024-12-21T07:55:14.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa resource = Database result = Ok(()) uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100292024-12-21T07:55:14.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa roles = RoleSet { roles: {} } uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100302024-12-21T07:55:14.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa resource = Database result = Ok(()) uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100312024-12-21T07:55:15.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa roles = RoleSet { roles: {} } uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100322024-12-21T07:55:15.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa resource = Database result = Ok(()) uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100332024-12-21T07:55:15.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa roles = RoleSet { roles: {} } uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100342024-12-21T07:55:15.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa resource = Database result = Ok(()) uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100352024-12-21T07:55:15.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100362024-12-21T07:55:15.007ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, lookup_type: ById(623f0f1c-4347-40f3-8cf7-f7d7c77efac3) }, key: cab4c109-6d88-4009-bc4c-2833c9647a13, lookup_type: ById(cab4c109-6d88-4009-bc4c-2833c9647a13) }, key: d05e2a1f-945e-4e85-9195-e6992ffaf129, lookup_type: ById(d05e2a1f-945e-4e85-9195-e6992ffaf129) } result = Ok(()) uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100372024-12-21T07:55:15.008ZINFOnexus (dropshot_internal): starting update saga for d05e2a1f-945e-4e85-9195-e6992ffaf129 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1544 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T07:55:14.980852808Z }
100382024-12-21T07:55:15.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26995 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa response_code = 204 uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100392024-12-21T07:55:15.008ZDEBGnexus (dropshot_internal): preparing instance-update saga for d05e2a1f-945e-4e85-9195-e6992ffaf129... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f8e61c0d-86ac-4a0f-b50b-0913ed8d7afa uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100402024-12-21T07:55:15.008ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update
100412024-12-21T07:55:15.008ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"d05e2a1f-945e-4e85-9195-e6992ffaf129","lookup_type":{"ById":"d05e2a1f-945e-4e85-9195-e6992ffaf129"},"parent":{"key":"cab4c109-6d88-4009-bc4c-2833c9647a13","lookup_type":{"ById":"cab4c109-6d88-4009-bc4c-2833c9647a13"},"parent":{"key":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","lookup_type":{"ById":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update sec_id = a920b126-b55b-45c8-9984-5279bf662759
100422024-12-21T07:55:15.008ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update
100432024-12-21T07:55:15.008ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 891b7df8-7f89-4cb8-8d1d-85a5d7251058 uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T07:55:14.980852808Z }
100442024-12-21T07:55:15.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 891b7df8-7f89-4cb8-8d1d-85a5d7251058 roles = RoleSet { roles: {} } uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100452024-12-21T07:55:15.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 891b7df8-7f89-4cb8-8d1d-85a5d7251058 resource = Database result = Ok(()) uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100462024-12-21T07:55:15.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4243 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 891b7df8-7f89-4cb8-8d1d-85a5d7251058 response_code = 204 uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
100472024-12-21T07:55:15.037ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update
100482024-12-21T07:55:15.037ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update sec_id = a920b126-b55b-45c8-9984-5279bf662759
100492024-12-21T07:55:15.037ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
100502024-12-21T07:55:15.037ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848
100512024-12-21T07:55:15.042ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
100522024-12-21T07:55:15.042ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848
100532024-12-21T07:55:15.046ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
100542024-12-21T07:55:15.046ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848
100552024-12-21T07:55:15.051ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
100562024-12-21T07:55:15.051ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("3d177c68-80e7-42cf-87f1-8fdd89f2e8a4")) node_id = 0 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848
100572024-12-21T07:55:15.055ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
100582024-12-21T07:55:15.055ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848
100592024-12-21T07:55:15.061ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update
100602024-12-21T07:55:15.061ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100612024-12-21T07:55:15.061ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100622024-12-21T07:55:15.063ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100632024-12-21T07:55:15.063ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100642024-12-21T07:55:15.065ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100652024-12-21T07:55:15.065ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100662024-12-21T07:55:15.067ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100672024-12-21T07:55:15.067ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100682024-12-21T07:55:15.068ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100692024-12-21T07:55:15.069ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100702024-12-21T07:55:15.070ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100712024-12-21T07:55:15.070ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100722024-12-21T07:55:15.071ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100732024-12-21T07:55:15.075ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, lookup_type: ById(623f0f1c-4347-40f3-8cf7-f7d7c77efac3) }, key: cab4c109-6d88-4009-bc4c-2833c9647a13, lookup_type: ById(cab4c109-6d88-4009-bc4c-2833c9647a13) }, key: d05e2a1f-945e-4e85-9195-e6992ffaf129, lookup_type: ById(d05e2a1f-945e-4e85-9195-e6992ffaf129) } result = Ok(()) saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100742024-12-21T07:55:15.075ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance updater_id = 3d177c68-80e7-42cf-87f1-8fdd89f2e8a4
100752024-12-21T07:55:15.075ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100762024-12-21T07:55:15.075ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100772024-12-21T07:55:15.086ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance updater_id = 3d177c68-80e7-42cf-87f1-8fdd89f2e8a4
100782024-12-21T07:55:15.086ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100792024-12-21T07:55:15.087ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance
100802024-12-21T07:55:15.091ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 locked_gen = Generation(Generation(2)) saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = LockInstance updater_id = 3d177c68-80e7-42cf-87f1-8fdd89f2e8a4
100812024-12-21T07:55:15.091ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
100822024-12-21T07:55:15.091ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("3d177c68-80e7-42cf-87f1-8fdd89f2e8a4")}) node_id = 1 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848
100832024-12-21T07:55:15.095ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
100842024-12-21T07:55:15.095ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848
100852024-12-21T07:55:15.100ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
100862024-12-21T07:55:15.100ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
100872024-12-21T07:55:15.102ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
100882024-12-21T07:55:15.102ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
100892024-12-21T07:55:15.103ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
100902024-12-21T07:55:15.103ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
100912024-12-21T07:55:15.105ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
100922024-12-21T07:55:15.108ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, lookup_type: ById(623f0f1c-4347-40f3-8cf7-f7d7c77efac3) }, key: cab4c109-6d88-4009-bc4c-2833c9647a13, lookup_type: ById(cab4c109-6d88-4009-bc4c-2833c9647a13) }, key: d05e2a1f-945e-4e85-9195-e6992ffaf129, lookup_type: ById(d05e2a1f-945e-4e85-9195-e6992ffaf129) } result = Ok(()) saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
100932024-12-21T07:55:15.108ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
100942024-12-21T07:55:15.108ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
100952024-12-21T07:55:15.114ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: f7931a2d-2429-4377-a5f1-dcdb79a45850, time_created: 2024-12-21T07:54:54.390991Z, time_deleted: None, instance_id: d05e2a1f-945e-4e85-9195-e6992ffaf129, sled_id: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-21T07:55:14.980852Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-21T07:54:52.241600Z, gen: Generation(Generation(3)), propolis_id: Some(f7931a2d-2429-4377-a5f1-dcdb79a45850), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(f7931a2d-2429-4377-a5f1-dcdb79a45850 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-21T07:55:15.114139005Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
100962024-12-21T07:55:15.118ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update
100972024-12-21T07:55:15.121ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"d05e2a1f-945e-4e85-9195-e6992ffaf129","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"f7931a2d-2429-4377-a5f1-dcdb79a45850"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"d05e2a1f-945e-4e85-9195-e6992ffaf129","lookup_type":{"ById":"d05e2a1f-945e-4e85-9195-e6992ffaf129"},"parent":{"key":"cab4c109-6d88-4009-bc4c-2833c9647a13","lookup_type":{"ById":"cab4c109-6d88-4009-bc4c-2833c9647a13"},"parent":{"key":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","lookup_type":{"ById":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"3d177c68-80e7-42cf-87f1-8fdd89f2e8a4"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"cab4c109-6d88-4009-bc4c-2833c9647a13","ram_diff":1073741824},"destroy_active_vmm":"f7931a2d-2429-4377-a5f1-dcdb79a45850","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-21T07:55:15.114139005Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update sec_id = a920b126-b55b-45c8-9984-5279bf662759
100982024-12-21T07:55:15.121ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update
100992024-12-21T07:55:15.153ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update
101002024-12-21T07:55:15.153ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update sec_id = a920b126-b55b-45c8-9984-5279bf662759
101012024-12-21T07:55:15.153ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
101022024-12-21T07:55:15.153ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101032024-12-21T07:55:15.157ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
101042024-12-21T07:55:15.157ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101052024-12-21T07:55:15.162ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
101062024-12-21T07:55:15.162ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101072024-12-21T07:55:15.166ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
101082024-12-21T07:55:15.166ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("fbab502a-d685-4b99-97d4-fa3876e2e657")) node_id = 0 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101092024-12-21T07:55:15.171ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
101102024-12-21T07:55:15.171ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101112024-12-21T07:55:15.174ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 parent_lock = UpdaterLock { updater_id: 3d177c68-80e7-42cf-87f1-8fdd89f2e8a4, locked_gen: Generation(Generation(2)) } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update
101122024-12-21T07:55:15.174ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = BecomeUpdater
101132024-12-21T07:55:15.175ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = BecomeUpdater
101142024-12-21T07:55:15.191ZDEBGnexus (SagaExecutor): inherited lock from 3d177c68-80e7-42cf-87f1-8fdd89f2e8a4 to fbab502a-d685-4b99-97d4-fa3876e2e657 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 3d177c68-80e7-42cf-87f1-8fdd89f2e8a4 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = BecomeUpdater updater_id = fbab502a-d685-4b99-97d4-fa3876e2e657
101152024-12-21T07:55:15.191ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update
101162024-12-21T07:55:15.191ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
101172024-12-21T07:55:15.191ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("fbab502a-d685-4b99-97d4-fa3876e2e657")}) node_id = 1 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101182024-12-21T07:55:15.196ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
101192024-12-21T07:55:15.196ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101202024-12-21T07:55:15.201ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
101212024-12-21T07:55:15.201ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101222024-12-21T07:55:15.205ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
101232024-12-21T07:55:15.205ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101242024-12-21T07:55:15.213ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update
101252024-12-21T07:55:15.213ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129
101262024-12-21T07:55:15.215ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = UpdateNetworkConfig
101272024-12-21T07:55:15.215ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = UpdateNetworkConfig
101282024-12-21T07:55:15.217ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = UpdateNetworkConfig
101292024-12-21T07:55:15.218ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = UpdateNetworkConfig
101302024-12-21T07:55:15.219ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
101312024-12-21T07:55:15.219ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = UpdateNetworkConfig
101322024-12-21T07:55:15.220ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = UpdateNetworkConfig
101332024-12-21T07:55:15.221ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
101342024-12-21T07:55:15.221ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
101352024-12-21T07:55:15.221ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
101362024-12-21T07:55:15.223ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
101372024-12-21T07:55:15.224ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
101382024-12-21T07:55:15.224ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
101392024-12-21T07:55:15.224ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
101402024-12-21T07:55:15.229ZDEBGnexus: notifying dendrite of updates instance_id = Some(d05e2a1f-945e-4e85-9195-e6992ffaf129 (instance)) switch = switch0
101412024-12-21T07:55:15.229ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1648, tv_nsec: 928405983 } })
101422024-12-21T07:55:15.230ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
101432024-12-21T07:55:15.260ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
101442024-12-21T07:55:15.260ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101452024-12-21T07:55:15.260ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0496c53-25de-48c5-866b-ea9a3abbc72b", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:15 GMT"} })
101462024-12-21T07:55:15.260ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101472024-12-21T07:55:15.261ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
101482024-12-21T07:55:15.290ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
101492024-12-21T07:55:15.291ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b5d2bcd-07f0-444f-86bd-63bb34f5dd59", "content-length": "4", "date": "Sat, 21 Dec 2024 07:55:15 GMT"} })
101502024-12-21T07:55:15.293ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
101512024-12-21T07:55:15.293ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101522024-12-21T07:55:15.297ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
101532024-12-21T07:55:15.297ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101542024-12-21T07:55:15.300ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
101552024-12-21T07:55:15.300ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
101562024-12-21T07:55:15.315ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-21T07:55:15.305209Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, time_modified: Some(2024-12-21T07:55:15.305209Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: cab4c109-6d88-4009-bc4c-2833c9647a13, time_modified: Some(2024-12-21T07:55:15.305209Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update
101572024-12-21T07:55:15.315ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
101582024-12-21T07:55:15.315ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101592024-12-21T07:55:15.319ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
101602024-12-21T07:55:15.319ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101612024-12-21T07:55:15.322ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update
101622024-12-21T07:55:15.322ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = UnassignOximeterProducer
101632024-12-21T07:55:15.322ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = UnassignOximeterProducer
101642024-12-21T07:55:15.328ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 producer_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update
101652024-12-21T07:55:15.328ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = UnassignOximeterProducer
101662024-12-21T07:55:15.328ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = UnassignOximeterProducer
101672024-12-21T07:55:15.362ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = d05e2a1f-945e-4e85-9195-e6992ffaf129 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update
101682024-12-21T07:55:15.365ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = d05e2a1f-945e-4e85-9195-e6992ffaf129 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/d05e2a1f-945e-4e85-9195-e6992ffaf129
101692024-12-21T07:55:15.382ZDEBGnexus (SagaExecutor): client response oximeter-collector = d05e2a1f-945e-4e85-9195-e6992ffaf129 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/d05e2a1f-945e-4e85-9195-e6992ffaf129", status: 204, headers: {"x-request-id": "c7fde7f8-bb0a-49fc-a2b8-8d7822cadcbd", "date": "Sat, 21 Dec 2024 07:55:15 GMT"} }) saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update
101702024-12-21T07:55:15.382ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 producer_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update
101712024-12-21T07:55:15.384ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
101722024-12-21T07:55:15.384ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101732024-12-21T07:55:15.387ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
101742024-12-21T07:55:15.387ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101752024-12-21T07:55:15.391ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 lock = UpdaterLock { updater_id: fbab502a-d685-4b99-97d4-fa3876e2e657, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-21T07:55:15.114139005Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update
101762024-12-21T07:55:15.391ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = CommitInstanceUpdates
101772024-12-21T07:55:15.391ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = CommitInstanceUpdates
101782024-12-21T07:55:15.429ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 new_runtime = InstanceRuntimeState { time_updated: 2024-12-21T07:55:15.114139005Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update
101792024-12-21T07:55:15.429ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
101802024-12-21T07:55:15.429ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101812024-12-21T07:55:15.429ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
101822024-12-21T07:55:15.429ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
101832024-12-21T07:55:15.429ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
101842024-12-21T07:55:15.429ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101852024-12-21T07:55:15.429ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101862024-12-21T07:55:15.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101872024-12-21T07:55:15.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101882024-12-21T07:55:15.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101892024-12-21T07:55:15.433ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
101902024-12-21T07:55:15.433ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101912024-12-21T07:55:15.433ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101922024-12-21T07:55:15.433ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101932024-12-21T07:55:15.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101942024-12-21T07:55:15.435ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101952024-12-21T07:55:15.436ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
101962024-12-21T07:55:15.437ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("d05e2a1f-945e-4e85-9195-e6992ffaf129"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("f7931a2d-2429-4377-a5f1-dcdb79a45850")}) node_id = 7 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
101972024-12-21T07:55:15.437ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101982024-12-21T07:55:15.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101992024-12-21T07:55:15.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102002024-12-21T07:55:15.440ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
102012024-12-21T07:55:15.440ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
102022024-12-21T07:55:15.440ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102032024-12-21T07:55:15.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102042024-12-21T07:55:15.443ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
102052024-12-21T07:55:15.443ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
102062024-12-21T07:55:15.446ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
102072024-12-21T07:55:15.446ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
102082024-12-21T07:55:15.449ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update
102092024-12-21T07:55:15.449ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = ReleaseSledResources
102102024-12-21T07:55:15.449ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = ReleaseSledResources
102112024-12-21T07:55:15.469ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
102122024-12-21T07:55:15.469ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102132024-12-21T07:55:15.470ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a10a4a9-5b25-4c4e-b28f-92e09088e7e5", "content-length": "372", "date": "Sat, 21 Dec 2024 07:55:15 GMT"} })
102142024-12-21T07:55:15.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102152024-12-21T07:55:15.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102162024-12-21T07:55:15.474ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102172024-12-21T07:55:15.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102182024-12-21T07:55:15.480ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
102192024-12-21T07:55:15.480ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
102202024-12-21T07:55:15.484ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {7531d270-453f-488d-a6ea-cbbd8f6fea82: {10.151.2.175: {a26a91b6-4a41-45df-b044-cd3728d02b93}, 10.151.2.176: {a26a91b6-4a41-45df-b044-cd3728d02b93}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
102212024-12-21T07:55:15.484ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
102222024-12-21T07:55:15.484ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
102232024-12-21T07:55:15.484ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
102242024-12-21T07:55:15.484ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d475fec2-d216-4710-b711-01cd7a83666e", "date": "Sat, 21 Dec 2024 07:55:15 GMT"} })
102252024-12-21T07:55:15.484ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102262024-12-21T07:55:15.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102272024-12-21T07:55:15.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102282024-12-21T07:55:15.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102292024-12-21T07:55:15.488ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update
102302024-12-21T07:55:15.488ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = MarkVmmDeleted
102312024-12-21T07:55:15.488ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = MarkVmmDeleted
102322024-12-21T07:55:15.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102332024-12-21T07:55:15.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102342024-12-21T07:55:15.493ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
102352024-12-21T07:55:15.493ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102362024-12-21T07:55:15.493ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8d7144c0-7dcb-4789-89c9-9c0a8c53ceba", "date": "Sat, 21 Dec 2024 07:55:15 GMT"} })
102372024-12-21T07:55:15.495ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
102382024-12-21T07:55:15.495ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
102392024-12-21T07:55:15.495ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 66.165091ms iteration = 27 status = {}
102402024-12-21T07:55:15.498ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
102412024-12-21T07:55:15.498ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
102422024-12-21T07:55:15.501ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
102432024-12-21T07:55:15.501ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
102442024-12-21T07:55:15.502ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102452024-12-21T07:55:15.504ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102462024-12-21T07:55:15.504ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102472024-12-21T07:55:15.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102482024-12-21T07:55:15.505ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
102492024-12-21T07:55:15.505ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
102502024-12-21T07:55:15.505ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102512024-12-21T07:55:15.507ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102522024-12-21T07:55:15.507ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102532024-12-21T07:55:15.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102542024-12-21T07:55:15.507ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = ChainSuccessorSaga
102552024-12-21T07:55:15.508ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = ChainSuccessorSaga
102562024-12-21T07:55:15.509ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = ChainSuccessorSaga
102572024-12-21T07:55:15.509ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = ChainSuccessorSaga
102582024-12-21T07:55:15.510ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = ChainSuccessorSaga
102592024-12-21T07:55:15.511ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = ChainSuccessorSaga
102602024-12-21T07:55:15.512ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = ChainSuccessorSaga
102612024-12-21T07:55:15.515ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, lookup_type: ById(623f0f1c-4347-40f3-8cf7-f7d7c77efac3) }, key: cab4c109-6d88-4009-bc4c-2833c9647a13, lookup_type: ById(cab4c109-6d88-4009-bc4c-2833c9647a13) }, key: d05e2a1f-945e-4e85-9195-e6992ffaf129, lookup_type: ById(d05e2a1f-945e-4e85-9195-e6992ffaf129) } result = Ok(()) saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = ChainSuccessorSaga
102622024-12-21T07:55:15.515ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = ChainSuccessorSaga
102632024-12-21T07:55:15.515ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_node = ChainSuccessorSaga
102642024-12-21T07:55:15.520ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 karmic_state = WillReincarnate needs_reincarnation = false saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update
102652024-12-21T07:55:15.520ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
102662024-12-21T07:55:15.520ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
102672024-12-21T07:55:15.540ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
102682024-12-21T07:55:15.540ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3273b97a-0338-4491-95df-0cec74e3dec1", "content-length": "691", "date": "Sat, 21 Dec 2024 07:55:15 GMT"} })
102692024-12-21T07:55:15.540ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
102702024-12-21T07:55:15.540ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
102712024-12-21T07:55:15.540ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
102722024-12-21T07:55:15.542ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 112.544192ms iteration = 26 status = {}
102732024-12-21T07:55:15.544ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
102742024-12-21T07:55:15.544ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
102752024-12-21T07:55:15.547ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
102762024-12-21T07:55:15.547ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
102772024-12-21T07:55:15.550ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 sec_id = a920b126-b55b-45c8-9984-5279bf662759
102782024-12-21T07:55:15.550ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976
102792024-12-21T07:55:15.563ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update sec_id = a920b126-b55b-45c8-9984-5279bf662759
102802024-12-21T07:55:15.563ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 saga_name = instance-update saga_result = SagaResult { saga_id: 3d2bedcc-b24e-4094-ae02-3ba3d1a78976, saga_log: SagaLog { saga_id: 3d2bedcc-b24e-4094-ae02-3ba3d1a78976, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("fbab502a-d685-4b99-97d4-fa3876e2e657")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("fbab502a-d685-4b99-97d4-fa3876e2e657")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("d05e2a1f-945e-4e85-9195-e6992ffaf129"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("f7931a2d-2429-4377-a5f1-dcdb79a45850")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("d05e2a1f-945e-4e85-9195-e6992ffaf129"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("f7931a2d-2429-4377-a5f1-dcdb79a45850")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("fbab502a-d685-4b99-97d4-fa3876e2e657"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("fbab502a-d685-4b99-97d4-fa3876e2e657")}} }) }
102812024-12-21T07:55:15.563ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 3d2bedcc-b24e-4094-ae02-3ba3d1a78976 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update
102822024-12-21T07:55:15.563ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
102832024-12-21T07:55:15.563ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848
102842024-12-21T07:55:15.566ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = a920b126-b55b-45c8-9984-5279bf662759
102852024-12-21T07:55:15.566ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848
102862024-12-21T07:55:15.569ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = a920b126-b55b-45c8-9984-5279bf662759
102872024-12-21T07:55:15.569ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848
102882024-12-21T07:55:15.573ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 sec_id = a920b126-b55b-45c8-9984-5279bf662759
102892024-12-21T07:55:15.573ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 29c4e23d-574c-4040-a472-94d1889bb848
102902024-12-21T07:55:15.607ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update sec_id = a920b126-b55b-45c8-9984-5279bf662759
102912024-12-21T07:55:15.607ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 29c4e23d-574c-4040-a472-94d1889bb848 saga_name = start-instance-update saga_result = SagaResult { saga_id: 29c4e23d-574c-4040-a472-94d1889bb848, saga_log: SagaLog { saga_id: 29c4e23d-574c-4040-a472-94d1889bb848, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("3d177c68-80e7-42cf-87f1-8fdd89f2e8a4")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("3d177c68-80e7-42cf-87f1-8fdd89f2e8a4")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("3d177c68-80e7-42cf-87f1-8fdd89f2e8a4"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("3d177c68-80e7-42cf-87f1-8fdd89f2e8a4")}} }) }
102922024-12-21T07:55:15.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0dac08ec-cdd7-4713-8214-a7a4dc611f00 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
102932024-12-21T07:55:15.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0dac08ec-cdd7-4713-8214-a7a4dc611f00 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
102942024-12-21T07:55:15.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1813 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0dac08ec-cdd7-4713-8214-a7a4dc611f00 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
102952024-12-21T07:55:16.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 632d8a56-cdfe-4305-b704-2957ddc09924 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
102962024-12-21T07:55:16.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 632d8a56-cdfe-4305-b704-2957ddc09924 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
102972024-12-21T07:55:16.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 632d8a56-cdfe-4305-b704-2957ddc09924 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
102982024-12-21T07:55:16.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 321208d9-d25f-4cd5-8534-4464da91a88a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
102992024-12-21T07:55:16.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 321208d9-d25f-4cd5-8534-4464da91a88a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103002024-12-21T07:55:16.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1703 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 321208d9-d25f-4cd5-8534-4464da91a88a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103012024-12-21T07:55:18.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0c5db93a-98f1-4e3a-a0ee-8c98513488c9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103022024-12-21T07:55:18.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0c5db93a-98f1-4e3a-a0ee-8c98513488c9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103032024-12-21T07:55:18.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0c5db93a-98f1-4e3a-a0ee-8c98513488c9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103042024-12-21T07:55:19.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 090d937d-fb58-4e3e-be9a-b708166e9c24 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103052024-12-21T07:55:19.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 090d937d-fb58-4e3e-be9a-b708166e9c24 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103062024-12-21T07:55:19.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 090d937d-fb58-4e3e-be9a-b708166e9c24 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103072024-12-21T07:55:19.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = b2f6b108-c0d0-4254-a171-ed284615ccfd roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
103082024-12-21T07:55:19.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = b2f6b108-c0d0-4254-a171-ed284615ccfd resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
103092024-12-21T07:55:19.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2983 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = b2f6b108-c0d0-4254-a171-ed284615ccfd response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
103102024-12-21T07:55:19.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = c670196d-a8b3-4c5c-80d9-86f1d1168f5d roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
103112024-12-21T07:55:19.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = c670196d-a8b3-4c5c-80d9-86f1d1168f5d resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
103122024-12-21T07:55:19.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = c670196d-a8b3-4c5c-80d9-86f1d1168f5d response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
103132024-12-21T07:55:19.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1410 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 523d1ba2-6219-4f99-ac30-ac2df475d594 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
103142024-12-21T07:55:20.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3510c626-ab93-4ee7-85cd-1c68a38db532 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103152024-12-21T07:55:20.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3510c626-ab93-4ee7-85cd-1c68a38db532 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103162024-12-21T07:55:20.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1772 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3510c626-ab93-4ee7-85cd-1c68a38db532 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103172024-12-21T07:55:20.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
103182024-12-21T07:55:20.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103192024-12-21T07:55:20.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
103202024-12-21T07:55:20.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103212024-12-21T07:55:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103222024-12-21T07:55:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103232024-12-21T07:55:20.669ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103242024-12-21T07:55:20.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103252024-12-21T07:55:20.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103262024-12-21T07:55:20.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103272024-12-21T07:55:20.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103282024-12-21T07:55:20.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103292024-12-21T07:55:20.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103302024-12-21T07:55:20.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103312024-12-21T07:55:20.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103322024-12-21T07:55:20.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
103332024-12-21T07:55:20.679ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103342024-12-21T07:55:20.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103352024-12-21T07:55:20.690ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
103362024-12-21T07:55:20.691ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.664563ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
103372024-12-21T07:55:20.694ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 26.976009ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103382024-12-21T07:55:21.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 02ed28e2-f023-41c1-a1d3-df100bd420ec roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103392024-12-21T07:55:21.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 02ed28e2-f023-41c1-a1d3-df100bd420ec resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103402024-12-21T07:55:21.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 02ed28e2-f023-41c1-a1d3-df100bd420ec response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103412024-12-21T07:55:22.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f3f914e2-8492-4d37-b9b7-c85f14239f52 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103422024-12-21T07:55:22.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f3f914e2-8492-4d37-b9b7-c85f14239f52 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103432024-12-21T07:55:22.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f3f914e2-8492-4d37-b9b7-c85f14239f52 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103442024-12-21T07:55:23.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 72bc6405-b9b3-41f2-b283-258333cb5880 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103452024-12-21T07:55:23.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 72bc6405-b9b3-41f2-b283-258333cb5880 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103462024-12-21T07:55:23.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2624 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 72bc6405-b9b3-41f2-b283-258333cb5880 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103472024-12-21T07:55:24.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ebc0bd7e-553b-4ac3-b24d-54a78721435d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103482024-12-21T07:55:24.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ebc0bd7e-553b-4ac3-b24d-54a78721435d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103492024-12-21T07:55:24.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1826 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ebc0bd7e-553b-4ac3-b24d-54a78721435d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103502024-12-21T07:55:25.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 809af92c-e50e-4409-96f4-49ba6289364e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103512024-12-21T07:55:25.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 809af92c-e50e-4409-96f4-49ba6289364e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103522024-12-21T07:55:25.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 809af92c-e50e-4409-96f4-49ba6289364e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103532024-12-21T07:55:26.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a09562c9-167f-48e4-a6cf-4e44477ea27e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103542024-12-21T07:55:26.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a09562c9-167f-48e4-a6cf-4e44477ea27e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103552024-12-21T07:55:26.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a09562c9-167f-48e4-a6cf-4e44477ea27e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103562024-12-21T07:55:27.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1ed3d0d7-3ec5-45e8-88ba-b1ba321ce537 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103572024-12-21T07:55:27.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1ed3d0d7-3ec5-45e8-88ba-b1ba321ce537 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103582024-12-21T07:55:27.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1ed3d0d7-3ec5-45e8-88ba-b1ba321ce537 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103592024-12-21T07:55:28.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3aeae155-d033-40cd-93a2-6c5eb602eebd roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103602024-12-21T07:55:28.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3aeae155-d033-40cd-93a2-6c5eb602eebd resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103612024-12-21T07:55:28.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2541 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3aeae155-d033-40cd-93a2-6c5eb602eebd response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103622024-12-21T07:55:29.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 688c1596-5d49-4269-9af1-41fa16a9ce28 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103632024-12-21T07:55:29.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 688c1596-5d49-4269-9af1-41fa16a9ce28 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103642024-12-21T07:55:29.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1890 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 688c1596-5d49-4269-9af1-41fa16a9ce28 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103652024-12-21T07:55:29.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1435 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 9b49863e-1c51-4588-bbec-20e613ded71b response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
103662024-12-21T07:55:30.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d0f91b08-417e-4c8c-b741-9737bae20eb6 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103672024-12-21T07:55:30.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d0f91b08-417e-4c8c-b741-9737bae20eb6 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103682024-12-21T07:55:30.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d0f91b08-417e-4c8c-b741-9737bae20eb6 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
103692024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
103702024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
103712024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
103722024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103732024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
103742024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103752024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
103762024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
103772024-12-21T07:55:30.666ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
103782024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
103792024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103802024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
103812024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
103822024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
103832024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103842024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
103852024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
103862024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
103872024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103882024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
103892024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
103902024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
103912024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103922024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
103932024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
103942024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
103952024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
103962024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103972024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103982024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
103992024-12-21T07:55:30.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
104002024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
104012024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104022024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
104032024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104042024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104052024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
104062024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
104072024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104082024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
104092024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104102024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
104112024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
104122024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104132024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
104142024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104152024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
104162024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104172024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104182024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
104192024-12-21T07:55:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
104202024-12-21T07:55:30.668ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104212024-12-21T07:55:30.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104222024-12-21T07:55:30.670ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.874285ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
104232024-12-21T07:55:30.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104242024-12-21T07:55:30.671ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104252024-12-21T07:55:30.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.245167ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
104262024-12-21T07:55:30.672ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1664, tv_nsec: 370652322 } })
104272024-12-21T07:55:30.672ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
104282024-12-21T07:55:30.672ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104292024-12-21T07:55:30.673ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
104302024-12-21T07:55:30.673ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104312024-12-21T07:55:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104322024-12-21T07:55:30.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
104332024-12-21T07:55:30.674ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104342024-12-21T07:55:30.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104352024-12-21T07:55:30.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
104362024-12-21T07:55:30.674ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104372024-12-21T07:55:30.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
104382024-12-21T07:55:30.675ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104392024-12-21T07:55:30.675ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104402024-12-21T07:55:30.676ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1664, tv_nsec: 374815231 } })
104412024-12-21T07:55:30.676ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
104422024-12-21T07:55:30.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
104432024-12-21T07:55:30.677ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104442024-12-21T07:55:30.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104452024-12-21T07:55:30.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
104462024-12-21T07:55:30.678ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104472024-12-21T07:55:30.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104482024-12-21T07:55:30.681ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.37457ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104492024-12-21T07:55:30.683ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104502024-12-21T07:55:30.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104512024-12-21T07:55:30.683ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104522024-12-21T07:55:30.683ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1664, tv_nsec: 382390437 } })
104532024-12-21T07:55:30.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104542024-12-21T07:55:30.684ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
104552024-12-21T07:55:30.688ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104562024-12-21T07:55:30.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104572024-12-21T07:55:30.696ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104582024-12-21T07:55:30.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104592024-12-21T07:55:30.697ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
104602024-12-21T07:55:30.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
104612024-12-21T07:55:30.698ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104622024-12-21T07:55:30.699ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 32.497851ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
104632024-12-21T07:55:30.700ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
104642024-12-21T07:55:30.700ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104652024-12-21T07:55:30.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104662024-12-21T07:55:30.703ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104672024-12-21T07:55:30.703ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
104682024-12-21T07:55:30.703ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
104692024-12-21T07:55:30.703ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104702024-12-21T07:55:30.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104712024-12-21T07:55:30.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
104722024-12-21T07:55:30.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104732024-12-21T07:55:30.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104742024-12-21T07:55:30.706ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104752024-12-21T07:55:30.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104762024-12-21T07:55:30.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104772024-12-21T07:55:30.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104782024-12-21T07:55:30.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104792024-12-21T07:55:30.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104802024-12-21T07:55:30.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104812024-12-21T07:55:30.711ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104822024-12-21T07:55:30.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104832024-12-21T07:55:30.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
104842024-12-21T07:55:30.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104852024-12-21T07:55:30.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104862024-12-21T07:55:30.714ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
104872024-12-21T07:55:30.714ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 47.482521ms iteration = 26 status = 0
104882024-12-21T07:55:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
104892024-12-21T07:55:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
104902024-12-21T07:55:30.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104912024-12-21T07:55:30.714ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
104922024-12-21T07:55:30.714ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 48.07829ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
104932024-12-21T07:55:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104942024-12-21T07:55:30.714ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
104952024-12-21T07:55:30.714ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104962024-12-21T07:55:30.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104972024-12-21T07:55:30.718ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104982024-12-21T07:55:30.720ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
104992024-12-21T07:55:30.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105002024-12-21T07:55:30.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105012024-12-21T07:55:30.721ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105022024-12-21T07:55:30.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105032024-12-21T07:55:30.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105042024-12-21T07:55:30.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105052024-12-21T07:55:30.728ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
105062024-12-21T07:55:30.728ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.780098ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
105072024-12-21T07:55:30.731ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105082024-12-21T07:55:30.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
105092024-12-21T07:55:30.733ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105102024-12-21T07:55:30.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105112024-12-21T07:55:30.735ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105122024-12-21T07:55:30.735ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
105132024-12-21T07:55:30.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105142024-12-21T07:55:30.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105152024-12-21T07:55:30.747ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
105162024-12-21T07:55:30.748ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105172024-12-21T07:55:30.748ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bf3e22e-de05-4928-984a-207d2b0265e5", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:30 GMT"} })
105182024-12-21T07:55:30.748ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105192024-12-21T07:55:30.750ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
105202024-12-21T07:55:30.753ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.624151ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
105212024-12-21T07:55:30.758ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
105222024-12-21T07:55:30.758ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105232024-12-21T07:55:30.759ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd2ffb94-9c16-4e10-b6f0-ef3833ac89d6", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:30 GMT"} })
105242024-12-21T07:55:30.759ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105252024-12-21T07:55:30.763ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
105262024-12-21T07:55:30.764ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.912409ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
105272024-12-21T07:55:30.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 100.270388ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
105282024-12-21T07:55:30.776ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105292024-12-21T07:55:30.776ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
105302024-12-21T07:55:30.776ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.782456ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
105312024-12-21T07:55:30.798ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
105322024-12-21T07:55:30.798ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105332024-12-21T07:55:30.799ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "86c74dd3-7520-4cd5-b902-959da252bf50", "content-length": "26", "date": "Sat, 21 Dec 2024 07:55:30 GMT"} })
105342024-12-21T07:55:30.799ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105352024-12-21T07:55:30.802ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
105362024-12-21T07:55:30.844ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 177.592475ms iteration = 30 status = {"physical_disks_added":0}
105372024-12-21T07:55:30.899ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
105382024-12-21T07:55:30.900ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dfa9033-9622-4bf8-b60b-cd3ef813e8c7", "content-length": "2", "date": "Sat, 21 Dec 2024 07:55:30 GMT"} })
105392024-12-21T07:55:30.902ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
105402024-12-21T07:55:30.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105412024-12-21T07:55:30.904ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 237.495702ms iteration = 26 status = null
105422024-12-21T07:55:30.913ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
105432024-12-21T07:55:30.913ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
105442024-12-21T07:55:30.914ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1155f202-077f-413e-adb1-2727ccf8fc1c", "content-length": "372", "date": "Sat, 21 Dec 2024 07:55:29 GMT"} })
105452024-12-21T07:55:30.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105462024-12-21T07:55:30.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105472024-12-21T07:55:30.955ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
105482024-12-21T07:55:30.955ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
105492024-12-21T07:55:30.956ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "35a6bd6b-b8b8-4acf-a3b0-65bb41964112", "date": "Sat, 21 Dec 2024 07:55:30 GMT"} })
105502024-12-21T07:55:30.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105512024-12-21T07:55:30.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105522024-12-21T07:55:30.962ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 295.67672ms iteration = 26 status = {}
105532024-12-21T07:55:30.988ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
105542024-12-21T07:55:30.989ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d280e6ea-b18e-42dd-ac78-bfef52dc9712", "content-length": "691", "date": "Sat, 21 Dec 2024 07:55:30 GMT"} })
105552024-12-21T07:55:30.989ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
105562024-12-21T07:55:30.989ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
105572024-12-21T07:55:30.989ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
105582024-12-21T07:55:30.990ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 324.165864ms iteration = 27 status = {}
105592024-12-21T07:55:30.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105602024-12-21T07:55:30.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105612024-12-21T07:55:30.994ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105622024-12-21T07:55:30.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105632024-12-21T07:55:30.998ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
105642024-12-21T07:55:30.998ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
105652024-12-21T07:55:30.998ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "533777d5-a4be-4bfe-879c-4d7efd052086", "date": "Sat, 21 Dec 2024 07:55:30 GMT"} })
105662024-12-21T07:55:31.000ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 333.846215ms iteration = 28 status = {}
105672024-12-21T07:55:31.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105682024-12-21T07:55:31.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105692024-12-21T07:55:31.035ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
105702024-12-21T07:55:31.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105712024-12-21T07:55:31.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105722024-12-21T07:55:31.045ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
105732024-12-21T07:55:31.045ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "851a689e-41fc-4a73-bf46-0b92cabd8cbf", "content-length": "134", "date": "Sat, 21 Dec 2024 07:55:30 GMT"} })
105742024-12-21T07:55:31.045ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
105752024-12-21T07:55:31.045ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
105762024-12-21T07:55:31.046ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
105772024-12-21T07:55:31.046ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
105782024-12-21T07:55:31.046ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105792024-12-21T07:55:31.046ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105802024-12-21T07:55:31.046ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105812024-12-21T07:55:31.046ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
105822024-12-21T07:55:31.046ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105832024-12-21T07:55:31.046ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
105842024-12-21T07:55:31.046ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
105852024-12-21T07:55:31.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105862024-12-21T07:55:31.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105872024-12-21T07:55:31.048ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
105882024-12-21T07:55:31.048ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4d3518e-f6f5-4c7f-9369-f9a678b2a8e8", "content-length": "2", "date": "Sat, 21 Dec 2024 07:55:30 GMT"} })
105892024-12-21T07:55:31.048ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
105902024-12-21T07:55:31.048ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1594dad1-013a-4b09-9255-cc61ea6e7201", "content-length": "52", "date": "Sat, 21 Dec 2024 07:55:30 GMT"} })
105912024-12-21T07:55:31.048ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
105922024-12-21T07:55:31.048ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
105932024-12-21T07:55:31.149ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e32020fa-b51f-4884-ac66-4484aa5546f1", "date": "Sat, 21 Dec 2024 07:55:30 GMT"} })
105942024-12-21T07:55:31.150ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
105952024-12-21T07:55:31.150ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
105962024-12-21T07:55:31.235ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1605dd64-1937-4d19-874e-c20f3d97e923", "content-length": "682", "date": "Sat, 21 Dec 2024 07:55:30 GMT"} })
105972024-12-21T07:55:31.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105982024-12-21T07:55:31.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105992024-12-21T07:55:31.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106002024-12-21T07:55:31.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106012024-12-21T07:55:31.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106022024-12-21T07:55:31.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106032024-12-21T07:55:31.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106042024-12-21T07:55:31.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106052024-12-21T07:55:31.252ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 585.35856ms iteration = 26 status = {}
106062024-12-21T07:55:31.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f17d72c3-37b0-400b-80de-b6b4c722ee90 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106072024-12-21T07:55:31.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f17d72c3-37b0-400b-80de-b6b4c722ee90 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106082024-12-21T07:55:31.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f17d72c3-37b0-400b-80de-b6b4c722ee90 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106092024-12-21T07:55:32.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2825f3e7-04e8-4f8b-984a-55c86728c7aa roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106102024-12-21T07:55:32.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2825f3e7-04e8-4f8b-984a-55c86728c7aa resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106112024-12-21T07:55:32.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2825f3e7-04e8-4f8b-984a-55c86728c7aa response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106122024-12-21T07:55:33.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2f3082c-aece-4734-96a7-87c2a3e066fc roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106132024-12-21T07:55:33.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2f3082c-aece-4734-96a7-87c2a3e066fc resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106142024-12-21T07:55:33.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d2f3082c-aece-4734-96a7-87c2a3e066fc response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106152024-12-21T07:55:34.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e6d335e6-a81c-4f2d-a16a-b67f0d529d3d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106162024-12-21T07:55:34.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e6d335e6-a81c-4f2d-a16a-b67f0d529d3d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106172024-12-21T07:55:34.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2778 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e6d335e6-a81c-4f2d-a16a-b67f0d529d3d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106182024-12-21T07:55:35.267ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:51756
106192024-12-21T07:55:35.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51756 req_id = 20b4c6c3-1a81-4822-9540-01def9f49713 roles = RoleSet { roles: {} } uri = /metrics/producers
106202024-12-21T07:55:35.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51756 req_id = 20b4c6c3-1a81-4822-9540-01def9f49713 resource = Database result = Ok(()) uri = /metrics/producers
106212024-12-21T07:55:35.310ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = e2e45dd6-1479-4aab-8030-3bcab95a4f4b
106222024-12-21T07:55:35.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42911 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51756 req_id = 20b4c6c3-1a81-4822-9540-01def9f49713 response_code = 201 uri = /metrics/producers
106232024-12-21T07:55:35.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1ffb7df4-3b8b-41c0-9930-2fbcbc8f9d17 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106242024-12-21T07:55:35.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1ffb7df4-3b8b-41c0-9930-2fbcbc8f9d17 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106252024-12-21T07:55:35.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1ffb7df4-3b8b-41c0-9930-2fbcbc8f9d17 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106262024-12-21T07:55:36.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dd416f68-e7fb-40de-9469-84df2045f406 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106272024-12-21T07:55:36.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dd416f68-e7fb-40de-9469-84df2045f406 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106282024-12-21T07:55:36.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2744 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dd416f68-e7fb-40de-9469-84df2045f406 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106292024-12-21T07:55:37.323ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:44560
106302024-12-21T07:55:37.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44560 req_id = a9f3cccb-27df-474b-8531-7249a8e72e08 roles = RoleSet { roles: {} } uri = /metrics/producers
106312024-12-21T07:55:37.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44560 req_id = a9f3cccb-27df-474b-8531-7249a8e72e08 resource = Database result = Ok(()) uri = /metrics/producers
106322024-12-21T07:55:37.361ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 5032d219-f3bf-40f5-8e36-efba904d39be
106332024-12-21T07:55:37.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37863 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44560 req_id = a9f3cccb-27df-474b-8531-7249a8e72e08 response_code = 201 uri = /metrics/producers
106342024-12-21T07:55:37.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 16a61106-c8c2-4c4a-aded-72c77703144a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106352024-12-21T07:55:37.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 16a61106-c8c2-4c4a-aded-72c77703144a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106362024-12-21T07:55:37.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 16a61106-c8c2-4c4a-aded-72c77703144a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106372024-12-21T07:55:38.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8c66c17-6b95-4b6c-892e-f689e6cab9ba roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106382024-12-21T07:55:38.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8c66c17-6b95-4b6c-892e-f689e6cab9ba resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106392024-12-21T07:55:38.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2901 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b8c66c17-6b95-4b6c-892e-f689e6cab9ba response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106402024-12-21T07:55:39.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 695eea2c-4a8a-48a7-bf37-af05657c3f91 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106412024-12-21T07:55:39.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 695eea2c-4a8a-48a7-bf37-af05657c3f91 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106422024-12-21T07:55:39.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1541 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 695eea2c-4a8a-48a7-bf37-af05657c3f91 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106432024-12-21T07:55:39.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1839 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 23797ed0-1892-4032-af34-6ddb2da0106c response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
106442024-12-21T07:55:40.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6699a4ce-3671-42b0-9ff5-4bedcc63ab34 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106452024-12-21T07:55:40.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6699a4ce-3671-42b0-9ff5-4bedcc63ab34 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106462024-12-21T07:55:40.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6699a4ce-3671-42b0-9ff5-4bedcc63ab34 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106472024-12-21T07:55:40.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
106482024-12-21T07:55:40.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
106492024-12-21T07:55:40.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106502024-12-21T07:55:40.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106512024-12-21T07:55:40.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106522024-12-21T07:55:40.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106532024-12-21T07:55:40.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106542024-12-21T07:55:40.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106552024-12-21T07:55:40.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106562024-12-21T07:55:40.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106572024-12-21T07:55:40.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106582024-12-21T07:55:40.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106592024-12-21T07:55:40.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106602024-12-21T07:55:40.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
106612024-12-21T07:55:40.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106622024-12-21T07:55:40.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106632024-12-21T07:55:40.692ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
106642024-12-21T07:55:40.692ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.761692ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
106652024-12-21T07:55:40.696ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106662024-12-21T07:55:40.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106672024-12-21T07:55:40.724ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.194671ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106682024-12-21T07:55:41.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1354174f-102d-49ec-a804-3965ebcc43f5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106692024-12-21T07:55:41.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1354174f-102d-49ec-a804-3965ebcc43f5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106702024-12-21T07:55:41.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1354174f-102d-49ec-a804-3965ebcc43f5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106712024-12-21T07:55:41.708ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:33084
106722024-12-21T07:55:41.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33084 req_id = 78050cca-85d8-4ec6-94e3-c6da5af46af7 roles = RoleSet { roles: {} } uri = /metrics/producers
106732024-12-21T07:55:41.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33084 req_id = 78050cca-85d8-4ec6-94e3-c6da5af46af7 resource = Database result = Ok(()) uri = /metrics/producers
106742024-12-21T07:55:41.743ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 5518d5c2-1f45-4e85-8fb9-41e1149133a1
106752024-12-21T07:55:41.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35013 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33084 req_id = 78050cca-85d8-4ec6-94e3-c6da5af46af7 response_code = 201 uri = /metrics/producers
106762024-12-21T07:55:42.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7113b6f2-2cf7-4b42-a343-3dd782f49a52 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106772024-12-21T07:55:42.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7113b6f2-2cf7-4b42-a343-3dd782f49a52 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106782024-12-21T07:55:42.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2613 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7113b6f2-2cf7-4b42-a343-3dd782f49a52 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106792024-12-21T07:55:43.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c63d9f16-2b45-41c7-8875-7e0184667d30 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106802024-12-21T07:55:43.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c63d9f16-2b45-41c7-8875-7e0184667d30 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106812024-12-21T07:55:43.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c63d9f16-2b45-41c7-8875-7e0184667d30 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106822024-12-21T07:55:44.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e476c84d-d4e3-469d-984b-5bf9046bf950 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106832024-12-21T07:55:44.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e476c84d-d4e3-469d-984b-5bf9046bf950 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106842024-12-21T07:55:44.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2566 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e476c84d-d4e3-469d-984b-5bf9046bf950 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106852024-12-21T07:55:45.290ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:44543
106862024-12-21T07:55:45.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44543 req_id = a2e92a59-3a89-4677-bb02-83c3a3d703ca roles = RoleSet { roles: {} } uri = /metrics/producers
106872024-12-21T07:55:45.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44543 req_id = a2e92a59-3a89-4677-bb02-83c3a3d703ca resource = Database result = Ok(()) uri = /metrics/producers
106882024-12-21T07:55:45.302ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 54344af8-3e4f-4625-a3a8-19b1290c40fc
106892024-12-21T07:55:45.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12248 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44543 req_id = a2e92a59-3a89-4677-bb02-83c3a3d703ca response_code = 201 uri = /metrics/producers
106902024-12-21T07:55:45.470ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:56989
106912024-12-21T07:55:45.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56989 req_id = b77ebe5c-d91b-41b1-a0ca-d10437a086e2 roles = RoleSet { roles: {} } uri = /metrics/producers
106922024-12-21T07:55:45.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56989 req_id = b77ebe5c-d91b-41b1-a0ca-d10437a086e2 resource = Database result = Ok(()) uri = /metrics/producers
106932024-12-21T07:55:45.513ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 9c233aaf-fd1f-4081-b1ff-c3b56dd02b1b
106942024-12-21T07:55:45.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43236 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56989 req_id = b77ebe5c-d91b-41b1-a0ca-d10437a086e2 response_code = 201 uri = /metrics/producers
106952024-12-21T07:55:45.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a3ac7bdb-f2ab-429d-b5ee-cc8f53ba9b67 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106962024-12-21T07:55:45.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a3ac7bdb-f2ab-429d-b5ee-cc8f53ba9b67 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106972024-12-21T07:55:45.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2471 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a3ac7bdb-f2ab-429d-b5ee-cc8f53ba9b67 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
106982024-12-21T07:55:46.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 6225d30b-0e7d-4c10-980b-890745841123 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
106992024-12-21T07:55:46.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 6225d30b-0e7d-4c10-980b-890745841123 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
107002024-12-21T07:55:46.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 6225d30b-0e7d-4c10-980b-890745841123 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
107012024-12-21T07:55:46.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d99f89bb-b018-48b2-8eca-8f0c1b6e2f42 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107022024-12-21T07:55:46.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d99f89bb-b018-48b2-8eca-8f0c1b6e2f42 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107032024-12-21T07:55:46.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d99f89bb-b018-48b2-8eca-8f0c1b6e2f42 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107042024-12-21T07:55:47.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9a92f1c2-8220-4148-afba-4fc943728df2 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107052024-12-21T07:55:47.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9a92f1c2-8220-4148-afba-4fc943728df2 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107062024-12-21T07:55:47.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9a92f1c2-8220-4148-afba-4fc943728df2 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107072024-12-21T07:55:48.408ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:42276
107082024-12-21T07:55:48.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42276 req_id = be4ad092-d49f-455f-b38f-25d6160aebe7 roles = RoleSet { roles: {} } uri = /metrics/producers
107092024-12-21T07:55:48.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42276 req_id = be4ad092-d49f-455f-b38f-25d6160aebe7 resource = Database result = Ok(()) uri = /metrics/producers
107102024-12-21T07:55:48.418ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107112024-12-21T07:55:48.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9821 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42276 req_id = be4ad092-d49f-455f-b38f-25d6160aebe7 response_code = 201 uri = /metrics/producers
107122024-12-21T07:55:48.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d65b680d-c7d1-421a-a141-cfe661cede26 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107132024-12-21T07:55:48.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d65b680d-c7d1-421a-a141-cfe661cede26 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107142024-12-21T07:55:48.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d65b680d-c7d1-421a-a141-cfe661cede26 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107152024-12-21T07:55:49.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 65829a55-dc87-468b-8b70-66f9f8a71f50 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107162024-12-21T07:55:49.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 65829a55-dc87-468b-8b70-66f9f8a71f50 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107172024-12-21T07:55:49.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 65829a55-dc87-468b-8b70-66f9f8a71f50 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107182024-12-21T07:55:49.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 78ea9350-5859-496c-be3c-beec9c6f9807 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
107192024-12-21T07:55:49.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 78ea9350-5859-496c-be3c-beec9c6f9807 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
107202024-12-21T07:55:49.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 78ea9350-5859-496c-be3c-beec9c6f9807 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
107212024-12-21T07:55:49.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 3a12f3e5-ac7b-47d7-b92d-cdd1513fe3a3 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
107222024-12-21T07:55:49.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 3a12f3e5-ac7b-47d7-b92d-cdd1513fe3a3 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
107232024-12-21T07:55:49.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 3a12f3e5-ac7b-47d7-b92d-cdd1513fe3a3 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
107242024-12-21T07:55:49.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1427 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = b33bc849-4110-4c0a-b1bf-35196ad02403 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
107252024-12-21T07:55:50.666ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
107262024-12-21T07:55:50.666ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107272024-12-21T07:55:50.666ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
107282024-12-21T07:55:50.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107292024-12-21T07:55:50.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107302024-12-21T07:55:50.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107312024-12-21T07:55:50.668ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107322024-12-21T07:55:50.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107332024-12-21T07:55:50.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107342024-12-21T07:55:50.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107352024-12-21T07:55:50.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107362024-12-21T07:55:50.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107372024-12-21T07:55:50.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107382024-12-21T07:55:50.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107392024-12-21T07:55:50.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.079681ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107402024-12-21T07:55:50.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107412024-12-21T07:55:50.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
107422024-12-21T07:55:50.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107432024-12-21T07:55:50.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107442024-12-21T07:55:50.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 86f13e4f-bfdb-45dd-8596-80678778ecbc roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107452024-12-21T07:55:50.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 86f13e4f-bfdb-45dd-8596-80678778ecbc resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107462024-12-21T07:55:50.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 86f13e4f-bfdb-45dd-8596-80678778ecbc response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107472024-12-21T07:55:50.716ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
107482024-12-21T07:55:50.716ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.29374ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
107492024-12-21T07:55:51.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8915622d-cabb-4e98-9903-00610e561d90 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107502024-12-21T07:55:51.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8915622d-cabb-4e98-9903-00610e561d90 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107512024-12-21T07:55:51.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8915622d-cabb-4e98-9903-00610e561d90 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107522024-12-21T07:55:52.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d758e6cd-c93f-49c9-a456-dbc75264b2aa roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107532024-12-21T07:55:52.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d758e6cd-c93f-49c9-a456-dbc75264b2aa resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107542024-12-21T07:55:52.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1771 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d758e6cd-c93f-49c9-a456-dbc75264b2aa response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107552024-12-21T07:55:53.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ed3181b5-2713-4078-9a1a-fa2d8c27170f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107562024-12-21T07:55:53.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ed3181b5-2713-4078-9a1a-fa2d8c27170f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107572024-12-21T07:55:53.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ed3181b5-2713-4078-9a1a-fa2d8c27170f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107582024-12-21T07:55:54.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3d2ce366-9bbd-487e-adea-1883feb4a165 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107592024-12-21T07:55:54.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3d2ce366-9bbd-487e-adea-1883feb4a165 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107602024-12-21T07:55:54.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3d2ce366-9bbd-487e-adea-1883feb4a165 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107612024-12-21T07:55:55.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eebcbea3-7a33-49f2-b610-d5800a64032d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107622024-12-21T07:55:55.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eebcbea3-7a33-49f2-b610-d5800a64032d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107632024-12-21T07:55:55.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eebcbea3-7a33-49f2-b610-d5800a64032d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107642024-12-21T07:55:56.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cacdc375-1a49-48e5-a78e-a7a0c96023f6 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107652024-12-21T07:55:56.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cacdc375-1a49-48e5-a78e-a7a0c96023f6 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107662024-12-21T07:55:56.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cacdc375-1a49-48e5-a78e-a7a0c96023f6 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107672024-12-21T07:55:57.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3d4cabfc-0937-4629-a854-a89ffb79ecd8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107682024-12-21T07:55:57.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3d4cabfc-0937-4629-a854-a89ffb79ecd8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107692024-12-21T07:55:57.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3d4cabfc-0937-4629-a854-a89ffb79ecd8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107702024-12-21T07:55:58.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7e510011-f1a4-4d0f-8fcb-0c0d3716951d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107712024-12-21T07:55:58.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7e510011-f1a4-4d0f-8fcb-0c0d3716951d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107722024-12-21T07:55:58.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7e510011-f1a4-4d0f-8fcb-0c0d3716951d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107732024-12-21T07:55:59.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1453 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 85b16f4a-75c9-4e8e-a74d-7c62c53fbd40 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
107742024-12-21T07:55:59.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2d70445a-b07d-4642-944f-d50b3d09bbbe roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107752024-12-21T07:55:59.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2d70445a-b07d-4642-944f-d50b3d09bbbe resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107762024-12-21T07:55:59.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2d70445a-b07d-4642-944f-d50b3d09bbbe response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
107772024-12-21T07:56:00.666ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
107782024-12-21T07:56:00.666ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
107792024-12-21T07:56:00.666ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
107802024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
107812024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
107822024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
107832024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
107842024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
107852024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107862024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
107872024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
107882024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
107892024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107902024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
107912024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107922024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
107932024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107942024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
107952024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107962024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
107972024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
107982024-12-21T07:56:00.667ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:46:00.667061537 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
107992024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
108002024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
108012024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
108022024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108032024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
108042024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
108052024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
108062024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
108072024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
108082024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
108092024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
108102024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
108112024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108122024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
108132024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
108142024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
108152024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108162024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
108172024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
108182024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108192024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
108202024-12-21T07:56:00.667ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
108212024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
108222024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108232024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
108242024-12-21T07:56:00.667ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b
108252024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108262024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.65\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b"}
108272024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
108282024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
108292024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
108302024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
108312024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
108322024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
108332024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
108342024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
108352024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
108362024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
108372024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
108382024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108392024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
108402024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
108412024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
108422024-12-21T07:56:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
108432024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108442024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108452024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
108462024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
108472024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108482024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108492024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108502024-12-21T07:56:00.668ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dd95bbd-e009-486c-8c96-451a6e195a49.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1694, tv_nsec: 366407726 } })
108512024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108522024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
108532024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
108542024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108552024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108562024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
108572024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
108582024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
108592024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
108602024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108612024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108622024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
108632024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108642024-12-21T07:56:00.668ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bfae345-1659-4377-bca9-c55abec2aeb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7c426166-4f75-4a87-b9ac-c0d590aea49b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1694, tv_nsec: 366585919 } })
108652024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
108662024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.332492ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
108672024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
108682024-12-21T07:56:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.427234ms iteration = 15 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
108692024-12-21T07:56:00.670ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.491208ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
108702024-12-21T07:56:00.670ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108712024-12-21T07:56:00.671ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.80076ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
108722024-12-21T07:56:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
108732024-12-21T07:56:00.673ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
108742024-12-21T07:56:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
108752024-12-21T07:56:00.674ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1694, tv_nsec: 373510514 } })
108762024-12-21T07:56:00.675ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
108772024-12-21T07:56:00.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
108782024-12-21T07:56:00.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108792024-12-21T07:56:00.675ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:46:00.667061537 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
108802024-12-21T07:56:00.675ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.726665ms iteration = 14 status = {"expiration":"2024-12-21T07:46:00.667061537Z","pruned":[]}
108812024-12-21T07:56:00.675ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108822024-12-21T07:56:00.676ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108832024-12-21T07:56:00.677ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1694, tv_nsec: 376460643 } })
108842024-12-21T07:56:00.678ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
108852024-12-21T07:56:00.678ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
108862024-12-21T07:56:00.678ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108872024-12-21T07:56:00.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108882024-12-21T07:56:00.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
108892024-12-21T07:56:00.679ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108902024-12-21T07:56:00.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108912024-12-21T07:56:00.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108922024-12-21T07:56:00.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108932024-12-21T07:56:00.686ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108942024-12-21T07:56:00.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108952024-12-21T07:56:00.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108962024-12-21T07:56:00.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108972024-12-21T07:56:00.712ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
108982024-12-21T07:56:00.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
108992024-12-21T07:56:00.716ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.089784ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
109002024-12-21T07:56:00.719ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109012024-12-21T07:56:00.719ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109022024-12-21T07:56:00.719ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
109032024-12-21T07:56:00.719ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109042024-12-21T07:56:00.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109052024-12-21T07:56:00.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109062024-12-21T07:56:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109072024-12-21T07:56:00.722ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109082024-12-21T07:56:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
109092024-12-21T07:56:00.722ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109102024-12-21T07:56:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109112024-12-21T07:56:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
109122024-12-21T07:56:00.723ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.600702ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
109132024-12-21T07:56:00.725ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109142024-12-21T07:56:00.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109152024-12-21T07:56:00.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109162024-12-21T07:56:00.726ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109172024-12-21T07:56:00.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109182024-12-21T07:56:00.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
109192024-12-21T07:56:00.729ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
109202024-12-21T07:56:00.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
109212024-12-21T07:56:00.733ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.848372ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109222024-12-21T07:56:00.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109232024-12-21T07:56:00.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109242024-12-21T07:56:00.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109252024-12-21T07:56:00.735ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
109262024-12-21T07:56:00.735ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
109272024-12-21T07:56:00.736ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 69.082769ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
109282024-12-21T07:56:00.736ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109292024-12-21T07:56:00.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109302024-12-21T07:56:00.737ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
109312024-12-21T07:56:00.737ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
109322024-12-21T07:56:00.737ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.824342ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
109332024-12-21T07:56:00.737ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
109342024-12-21T07:56:00.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
109352024-12-21T07:56:00.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
109362024-12-21T07:56:00.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109372024-12-21T07:56:00.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109382024-12-21T07:56:00.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
109392024-12-21T07:56:00.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
109402024-12-21T07:56:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
109412024-12-21T07:56:00.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109422024-12-21T07:56:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109432024-12-21T07:56:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
109442024-12-21T07:56:00.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
109452024-12-21T07:56:00.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109462024-12-21T07:56:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109472024-12-21T07:56:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
109482024-12-21T07:56:00.741ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109492024-12-21T07:56:00.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109502024-12-21T07:56:00.744ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109512024-12-21T07:56:00.745ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1694, tv_nsec: 444020147 } })
109522024-12-21T07:56:00.745ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
109532024-12-21T07:56:00.746ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109542024-12-21T07:56:00.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109552024-12-21T07:56:00.747ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109562024-12-21T07:56:00.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
109572024-12-21T07:56:00.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109582024-12-21T07:56:00.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109592024-12-21T07:56:00.750ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109602024-12-21T07:56:00.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
109612024-12-21T07:56:00.750ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109622024-12-21T07:56:00.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109632024-12-21T07:56:00.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
109642024-12-21T07:56:00.754ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
109652024-12-21T07:56:00.754ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 87.630758ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
109662024-12-21T07:56:00.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109672024-12-21T07:56:00.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109682024-12-21T07:56:00.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109692024-12-21T07:56:00.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109702024-12-21T07:56:00.765ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109712024-12-21T07:56:00.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
109722024-12-21T07:56:00.767ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109732024-12-21T07:56:00.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109742024-12-21T07:56:00.768ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
109752024-12-21T07:56:00.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
109762024-12-21T07:56:00.769ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 102.531326ms iteration = 27 status = 0
109772024-12-21T07:56:00.770ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
109782024-12-21T07:56:00.770ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
109792024-12-21T07:56:00.770ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
109802024-12-21T07:56:00.770ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109812024-12-21T07:56:00.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
109822024-12-21T07:56:00.772ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109832024-12-21T07:56:00.772ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
109842024-12-21T07:56:00.772ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109852024-12-21T07:56:00.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109862024-12-21T07:56:00.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
109872024-12-21T07:56:00.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
109882024-12-21T07:56:00.778ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109892024-12-21T07:56:00.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
109902024-12-21T07:56:00.779ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109912024-12-21T07:56:00.783ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
109922024-12-21T07:56:00.783ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109932024-12-21T07:56:00.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
109942024-12-21T07:56:00.783ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 116.252944ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
109952024-12-21T07:56:00.784ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 117.270271ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
109962024-12-21T07:56:00.785ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
109972024-12-21T07:56:00.785ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 118.586053ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
109982024-12-21T07:56:00.791ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
109992024-12-21T07:56:00.791ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
110002024-12-21T07:56:00.791ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
110012024-12-21T07:56:00.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110022024-12-21T07:56:00.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110032024-12-21T07:56:00.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110042024-12-21T07:56:00.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110052024-12-21T07:56:00.808ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
110062024-12-21T07:56:00.808ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
110072024-12-21T07:56:00.808ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "64fdd719-31db-4678-92b8-058e0cca2012", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:00 GMT"} })
110082024-12-21T07:56:00.808ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
110092024-12-21T07:56:00.810ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
110102024-12-21T07:56:00.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110112024-12-21T07:56:00.814ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
110122024-12-21T07:56:00.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
110132024-12-21T07:56:00.818ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110142024-12-21T07:56:00.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110152024-12-21T07:56:00.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 164.129371ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
110162024-12-21T07:56:00.832ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110172024-12-21T07:56:00.832ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
110182024-12-21T07:56:00.832ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 164.729141ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
110192024-12-21T07:56:00.838ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:42:50.264108Z, time_modified: 2024-12-21T07:42:50.264108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }) }
110202024-12-21T07:56:00.838ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 171.529194ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]}},"default_endpoint":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
110212024-12-21T07:56:00.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110222024-12-21T07:56:00.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
110232024-12-21T07:56:00.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110242024-12-21T07:56:00.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110252024-12-21T07:56:00.871ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
110262024-12-21T07:56:00.871ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
110272024-12-21T07:56:00.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110282024-12-21T07:56:00.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110292024-12-21T07:56:00.880ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
110302024-12-21T07:56:00.880ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 0 version = 2
110312024-12-21T07:56:00.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110322024-12-21T07:56:00.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110332024-12-21T07:56:00.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110342024-12-21T07:56:00.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
110352024-12-21T07:56:00.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110362024-12-21T07:56:00.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110372024-12-21T07:56:00.909ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110382024-12-21T07:56:00.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
110392024-12-21T07:56:00.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110402024-12-21T07:56:00.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110412024-12-21T07:56:00.913ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 246.697734ms iteration = 31 status = {"physical_disks_added":0}
110422024-12-21T07:56:00.916ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
110432024-12-21T07:56:00.916ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 249.499691ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
110442024-12-21T07:56:00.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3c976944-ca93-480e-a9bb-fcd7583fadc2 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
110452024-12-21T07:56:00.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3c976944-ca93-480e-a9bb-fcd7583fadc2 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
110462024-12-21T07:56:00.923ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
110472024-12-21T07:56:00.958ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110482024-12-21T07:56:00.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110492024-12-21T07:56:00.970ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
110502024-12-21T07:56:00.970ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
110512024-12-21T07:56:00.970ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7f7e53b-f44e-4d60-9e70-7e1143f5e2c4", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:00 GMT"} })
110522024-12-21T07:56:00.970ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
110532024-12-21T07:56:00.972ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
110542024-12-21T07:56:01.005ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
110552024-12-21T07:56:01.005ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f98fb4e3-f3fb-43a4-bb82-7e0a8f46d13c", "content-length": "2", "date": "Sat, 21 Dec 2024 07:56:00 GMT"} })
110562024-12-21T07:56:01.007ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110572024-12-21T07:56:01.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
110582024-12-21T07:56:01.013ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
110592024-12-21T07:56:01.032ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
110602024-12-21T07:56:01.032ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
110612024-12-21T07:56:01.032ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9bbf0cb-f1fb-4dc9-9802-7457910da2cb", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:00 GMT"} })
110622024-12-21T07:56:01.033ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
110632024-12-21T07:56:01.034ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
110642024-12-21T07:56:01.035ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
110652024-12-21T07:56:01.035ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
110662024-12-21T07:56:01.035ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b7fa03a-c620-4708-96c5-9660fdd56b5c", "content-length": "372", "date": "Sat, 21 Dec 2024 07:56:00 GMT"} })
110672024-12-21T07:56:01.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110682024-12-21T07:56:01.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110692024-12-21T07:56:01.037ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 1 version = 2
110702024-12-21T07:56:01.037ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
110712024-12-21T07:56:01.037ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:43:41.075205 UTC dns_group = external generation = 2
110722024-12-21T07:56:01.037ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 370.525175ms iteration = 15 status = {"generation":2}
110732024-12-21T07:56:01.038ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
110742024-12-21T07:56:01.038ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
110752024-12-21T07:56:01.038ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:43:39.444085 UTC dns_group = internal generation = 1
110762024-12-21T07:56:01.038ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 371.306118ms iteration = 15 status = {"generation":1}
110772024-12-21T07:56:01.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115690 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3c976944-ca93-480e-a9bb-fcd7583fadc2 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
110782024-12-21T07:56:01.039ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110792024-12-21T07:56:01.039ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 372.57754ms iteration = 27 status = null
110802024-12-21T07:56:01.041ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
110812024-12-21T07:56:01.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110822024-12-21T07:56:01.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110832024-12-21T07:56:01.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110842024-12-21T07:56:01.044ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
110852024-12-21T07:56:01.044ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110862024-12-21T07:56:01.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110872024-12-21T07:56:01.091ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
110882024-12-21T07:56:01.091ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
110892024-12-21T07:56:01.092ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4dd32291-0e7b-4573-98ac-0badf08fafb8", "date": "Sat, 21 Dec 2024 07:56:01 GMT"} })
110902024-12-21T07:56:01.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110912024-12-21T07:56:01.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110922024-12-21T07:56:01.095ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110932024-12-21T07:56:01.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110942024-12-21T07:56:01.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110952024-12-21T07:56:01.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110962024-12-21T07:56:01.102ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
110972024-12-21T07:56:01.102ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
110982024-12-21T07:56:01.102ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4286b471-4a5f-4a7c-b61d-0fa94dc58f65", "date": "Sat, 21 Dec 2024 07:56:01 GMT"} })
110992024-12-21T07:56:01.104ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 437.585011ms iteration = 29 status = {}
111002024-12-21T07:56:01.110ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
111012024-12-21T07:56:01.111ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e4679f1c-2af4-47ab-9811-d7b566abade8", "date": "Sat, 21 Dec 2024 07:56:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
111022024-12-21T07:56:01.111ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
111032024-12-21T07:56:01.113ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0afd2df5-cece-4d65-a2d5-4bf2a9b580cc", "date": "Sat, 21 Dec 2024 07:56:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
111042024-12-21T07:56:01.113ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
111052024-12-21T07:56:01.114ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
111062024-12-21T07:56:01.114ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 447.74286ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
111072024-12-21T07:56:01.143ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
111082024-12-21T07:56:01.144ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6413fba9-4f47-4a5d-a949-12ee8d0e5067", "date": "Sat, 21 Dec 2024 07:56:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
111092024-12-21T07:56:01.144ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
111102024-12-21T07:56:01.145ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d346a86c-eb6c-4d00-bab1-08b057b48185", "date": "Sat, 21 Dec 2024 07:56:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
111112024-12-21T07:56:01.145ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
111122024-12-21T07:56:01.147ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2f1c03d6-6401-4969-8cea-3930222cd7ae", "date": "Sat, 21 Dec 2024 07:56:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
111132024-12-21T07:56:01.147ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
111142024-12-21T07:56:01.149ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
111152024-12-21T07:56:01.149ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 481.804547ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
111162024-12-21T07:56:01.153ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 486.610727ms iteration = 27 status = {}
111172024-12-21T07:56:01.256ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
111182024-12-21T07:56:01.256ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d974bd0-4dde-427f-a0b7-d48129ffd5b5", "content-length": "691", "date": "Sat, 21 Dec 2024 07:56:01 GMT"} })
111192024-12-21T07:56:01.256ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
111202024-12-21T07:56:01.256ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
111212024-12-21T07:56:01.256ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
111222024-12-21T07:56:01.258ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 591.799767ms iteration = 28 status = {}
111232024-12-21T07:56:01.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111242024-12-21T07:56:01.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111252024-12-21T07:56:01.288ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
111262024-12-21T07:56:01.288ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111272024-12-21T07:56:01.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111282024-12-21T07:56:01.298ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
111292024-12-21T07:56:01.299ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "121cfc6f-e138-463c-a525-f49b44ae98d1", "content-length": "134", "date": "Sat, 21 Dec 2024 07:56:00 GMT"} })
111302024-12-21T07:56:01.299ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
111312024-12-21T07:56:01.299ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
111322024-12-21T07:56:01.299ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
111332024-12-21T07:56:01.299ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
111342024-12-21T07:56:01.299ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111352024-12-21T07:56:01.299ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111362024-12-21T07:56:01.299ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111372024-12-21T07:56:01.299ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
111382024-12-21T07:56:01.299ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111392024-12-21T07:56:01.299ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
111402024-12-21T07:56:01.299ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
111412024-12-21T07:56:01.299ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111422024-12-21T07:56:01.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111432024-12-21T07:56:01.302ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
111442024-12-21T07:56:01.302ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "aaf840ff-ea8b-470c-89a5-050cfa9048cd", "content-length": "2", "date": "Sat, 21 Dec 2024 07:56:00 GMT"} })
111452024-12-21T07:56:01.302ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
111462024-12-21T07:56:01.302ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "abba60f2-f2a1-4bf8-918b-09c47d12246d", "content-length": "52", "date": "Sat, 21 Dec 2024 07:56:00 GMT"} })
111472024-12-21T07:56:01.302ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
111482024-12-21T07:56:01.302ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
111492024-12-21T07:56:01.399ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "86f81afb-cb3a-4900-aa3c-7ac03e781ff1", "date": "Sat, 21 Dec 2024 07:56:01 GMT"} })
111502024-12-21T07:56:01.399ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
111512024-12-21T07:56:01.399ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
111522024-12-21T07:56:01.403ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "feeeb0f5-afd3-4548-a1ad-e1bcc2c52997", "content-length": "682", "date": "Sat, 21 Dec 2024 07:56:01 GMT"} })
111532024-12-21T07:56:01.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111542024-12-21T07:56:01.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111552024-12-21T07:56:01.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111562024-12-21T07:56:01.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111572024-12-21T07:56:01.411ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111582024-12-21T07:56:01.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111592024-12-21T07:56:01.413ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111602024-12-21T07:56:01.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111612024-12-21T07:56:01.420ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 753.697431ms iteration = 27 status = {}
111622024-12-21T07:56:02.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1b19cf57-1cb2-4251-9cee-420626a37d50 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111632024-12-21T07:56:02.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1b19cf57-1cb2-4251-9cee-420626a37d50 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111642024-12-21T07:56:02.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1b19cf57-1cb2-4251-9cee-420626a37d50 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111652024-12-21T07:56:03.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dc13c9e4-4afd-48d5-ac05-4540503c0a4b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111662024-12-21T07:56:03.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dc13c9e4-4afd-48d5-ac05-4540503c0a4b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111672024-12-21T07:56:03.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dc13c9e4-4afd-48d5-ac05-4540503c0a4b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111682024-12-21T07:56:04.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 022f38a7-c71c-4a66-84a8-5b4aa4af2e9c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111692024-12-21T07:56:04.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 022f38a7-c71c-4a66-84a8-5b4aa4af2e9c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111702024-12-21T07:56:04.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 022f38a7-c71c-4a66-84a8-5b4aa4af2e9c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111712024-12-21T07:56:05.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3fbf40a5-48ed-477a-8699-1bdce0767fbd roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111722024-12-21T07:56:05.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3fbf40a5-48ed-477a-8699-1bdce0767fbd resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111732024-12-21T07:56:05.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3fbf40a5-48ed-477a-8699-1bdce0767fbd response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111742024-12-21T07:56:06.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9a15911a-087e-4181-9d1e-da5b2766c2cf roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111752024-12-21T07:56:06.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9a15911a-087e-4181-9d1e-da5b2766c2cf resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111762024-12-21T07:56:06.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9a15911a-087e-4181-9d1e-da5b2766c2cf response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111772024-12-21T07:56:07.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 43d398f3-2e20-4744-bd6a-1db5c49a560f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111782024-12-21T07:56:07.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 43d398f3-2e20-4744-bd6a-1db5c49a560f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111792024-12-21T07:56:07.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 43d398f3-2e20-4744-bd6a-1db5c49a560f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111802024-12-21T07:56:08.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d754198d-8e8a-45bf-93eb-49be35c5c72f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111812024-12-21T07:56:08.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d754198d-8e8a-45bf-93eb-49be35c5c72f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111822024-12-21T07:56:08.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2608 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d754198d-8e8a-45bf-93eb-49be35c5c72f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111832024-12-21T07:56:09.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7c0e6f37-8a68-4c62-ab6e-8716111962e7 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111842024-12-21T07:56:09.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7c0e6f37-8a68-4c62-ab6e-8716111962e7 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111852024-12-21T07:56:09.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7c0e6f37-8a68-4c62-ab6e-8716111962e7 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111862024-12-21T07:56:09.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1619 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = f0dbbd45-223b-4c5c-a38c-2cafad4e1204 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
111872024-12-21T07:56:10.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cc28fe44-7c5b-4af9-b972-a19ed7f85988 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111882024-12-21T07:56:10.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cc28fe44-7c5b-4af9-b972-a19ed7f85988 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111892024-12-21T07:56:10.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cc28fe44-7c5b-4af9-b972-a19ed7f85988 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
111902024-12-21T07:56:10.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
111912024-12-21T07:56:10.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
111922024-12-21T07:56:10.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111932024-12-21T07:56:10.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111942024-12-21T07:56:10.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111952024-12-21T07:56:10.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111962024-12-21T07:56:10.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111972024-12-21T07:56:10.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111982024-12-21T07:56:10.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111992024-12-21T07:56:10.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112002024-12-21T07:56:10.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112012024-12-21T07:56:10.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112022024-12-21T07:56:10.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112032024-12-21T07:56:10.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
112042024-12-21T07:56:10.679ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112052024-12-21T07:56:10.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112062024-12-21T07:56:10.692ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
112072024-12-21T07:56:10.693ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.326831ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
112082024-12-21T07:56:10.698ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112092024-12-21T07:56:10.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112102024-12-21T07:56:10.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.289616ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112112024-12-21T07:56:11.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a4817053-d78a-4b4b-b213-32da6883ab06 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112122024-12-21T07:56:11.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a4817053-d78a-4b4b-b213-32da6883ab06 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112132024-12-21T07:56:11.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a4817053-d78a-4b4b-b213-32da6883ab06 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112142024-12-21T07:56:12.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d4c69071-e591-4e2f-9b2f-7d38029abd10 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112152024-12-21T07:56:12.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d4c69071-e591-4e2f-9b2f-7d38029abd10 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112162024-12-21T07:56:12.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d4c69071-e591-4e2f-9b2f-7d38029abd10 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112172024-12-21T07:56:12.894ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
112182024-12-21T07:56:12.894ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
112192024-12-21T07:56:12.925ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
112202024-12-21T07:56:12.925ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:33593
112212024-12-21T07:56:12.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33593 req_id = 45647b80-0d87-48ac-a39d-9639a2399af4 roles = RoleSet { roles: {} } uri = /metrics/producers
112222024-12-21T07:56:12.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33593 req_id = 45647b80-0d87-48ac-a39d-9639a2399af4 resource = Database result = Ok(()) uri = /metrics/producers
112232024-12-21T07:56:12.934ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = a920b126-b55b-45c8-9984-5279bf662759
112242024-12-21T07:56:12.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9211 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33593 req_id = 45647b80-0d87-48ac-a39d-9639a2399af4 response_code = 201 uri = /metrics/producers
112252024-12-21T07:56:12.934ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "45647b80-0d87-48ac-a39d-9639a2399af4", "content-length": "41", "date": "Sat, 21 Dec 2024 07:56:12 GMT"} })
112262024-12-21T07:56:12.936ZDEBGnexus (producer-registration-task): registered with nexus successfully
112272024-12-21T07:56:12.936ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
112282024-12-21T07:56:13.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ff9c9155-55d0-49b4-a23d-1e7a90822994 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112292024-12-21T07:56:13.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ff9c9155-55d0-49b4-a23d-1e7a90822994 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112302024-12-21T07:56:13.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2583 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ff9c9155-55d0-49b4-a23d-1e7a90822994 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112312024-12-21T07:56:14.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6ab83a4f-32f8-4db1-b3e4-19fdfa54a075 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112322024-12-21T07:56:14.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6ab83a4f-32f8-4db1-b3e4-19fdfa54a075 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112332024-12-21T07:56:14.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1591 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6ab83a4f-32f8-4db1-b3e4-19fdfa54a075 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112342024-12-21T07:56:15.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5a168856-9596-4dc4-b796-1acdb054d121 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112352024-12-21T07:56:15.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5a168856-9596-4dc4-b796-1acdb054d121 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112362024-12-21T07:56:15.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5a168856-9596-4dc4-b796-1acdb054d121 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112372024-12-21T07:56:16.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = b34a1091-a0c9-4834-8dca-4f9562dcd76b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
112382024-12-21T07:56:16.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = b34a1091-a0c9-4834-8dca-4f9562dcd76b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
112392024-12-21T07:56:16.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3627 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = b34a1091-a0c9-4834-8dca-4f9562dcd76b response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
112402024-12-21T07:56:16.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6460f28a-a17f-449c-8474-4802ffee32bb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112412024-12-21T07:56:16.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6460f28a-a17f-449c-8474-4802ffee32bb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112422024-12-21T07:56:16.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6460f28a-a17f-449c-8474-4802ffee32bb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112432024-12-21T07:56:17.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 04aedac1-f4ae-4e5f-88e1-e66b472e292e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112442024-12-21T07:56:17.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 04aedac1-f4ae-4e5f-88e1-e66b472e292e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112452024-12-21T07:56:17.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 04aedac1-f4ae-4e5f-88e1-e66b472e292e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112462024-12-21T07:56:18.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 15f6b5d3-2c26-4ad4-a1e5-f8864ab3999f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112472024-12-21T07:56:18.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 15f6b5d3-2c26-4ad4-a1e5-f8864ab3999f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112482024-12-21T07:56:18.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 15f6b5d3-2c26-4ad4-a1e5-f8864ab3999f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112492024-12-21T07:56:19.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ff912da5-54c1-4027-baf0-d5a2d3741230 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112502024-12-21T07:56:19.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ff912da5-54c1-4027-baf0-d5a2d3741230 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112512024-12-21T07:56:19.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ff912da5-54c1-4027-baf0-d5a2d3741230 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112522024-12-21T07:56:19.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 6d41c916-5f25-4509-996b-ff1d8d5ad8f2 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
112532024-12-21T07:56:19.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 6d41c916-5f25-4509-996b-ff1d8d5ad8f2 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
112542024-12-21T07:56:19.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 6d41c916-5f25-4509-996b-ff1d8d5ad8f2 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
112552024-12-21T07:56:19.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 7c135a4c-f951-4312-9881-6a4b88041c1f roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
112562024-12-21T07:56:19.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 7c135a4c-f951-4312-9881-6a4b88041c1f resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
112572024-12-21T07:56:19.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 7c135a4c-f951-4312-9881-6a4b88041c1f response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
112582024-12-21T07:56:19.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1310 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = c447f1b1-d216-48cf-9239-8306ffdc7d86 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
112592024-12-21T07:56:20.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 95359130-c156-41c7-a941-6999ad41887c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112602024-12-21T07:56:20.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 95359130-c156-41c7-a941-6999ad41887c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112612024-12-21T07:56:20.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 95359130-c156-41c7-a941-6999ad41887c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112622024-12-21T07:56:20.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
112632024-12-21T07:56:20.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
112642024-12-21T07:56:20.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112652024-12-21T07:56:20.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112662024-12-21T07:56:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112672024-12-21T07:56:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112682024-12-21T07:56:20.669ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112692024-12-21T07:56:20.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112702024-12-21T07:56:20.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.659698ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112712024-12-21T07:56:20.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112722024-12-21T07:56:20.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112732024-12-21T07:56:20.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112742024-12-21T07:56:20.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112752024-12-21T07:56:20.700ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112762024-12-21T07:56:20.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112772024-12-21T07:56:20.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112782024-12-21T07:56:20.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
112792024-12-21T07:56:20.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112802024-12-21T07:56:20.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112812024-12-21T07:56:20.718ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
112822024-12-21T07:56:20.718ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.615183ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
112832024-12-21T07:56:21.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1edac5ff-6834-4d05-b959-694d4ca5d241 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112842024-12-21T07:56:21.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1edac5ff-6834-4d05-b959-694d4ca5d241 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112852024-12-21T07:56:21.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1edac5ff-6834-4d05-b959-694d4ca5d241 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112862024-12-21T07:56:22.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 47a4923b-4a86-484d-aca1-ecdcd1db56f0 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112872024-12-21T07:56:22.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 47a4923b-4a86-484d-aca1-ecdcd1db56f0 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112882024-12-21T07:56:22.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 47a4923b-4a86-484d-aca1-ecdcd1db56f0 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112892024-12-21T07:56:23.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 04851102-b056-45f7-9cec-3c7d916d4c05 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112902024-12-21T07:56:23.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 04851102-b056-45f7-9cec-3c7d916d4c05 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112912024-12-21T07:56:23.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2771 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 04851102-b056-45f7-9cec-3c7d916d4c05 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112922024-12-21T07:56:24.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 02c458e7-34d4-48cd-b49c-2fffddd95ddb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112932024-12-21T07:56:24.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 02c458e7-34d4-48cd-b49c-2fffddd95ddb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112942024-12-21T07:56:24.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 02c458e7-34d4-48cd-b49c-2fffddd95ddb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112952024-12-21T07:56:25.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3009109d-35c8-4a48-b700-a126e9c545fd roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112962024-12-21T07:56:25.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3009109d-35c8-4a48-b700-a126e9c545fd resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112972024-12-21T07:56:25.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3009109d-35c8-4a48-b700-a126e9c545fd response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112982024-12-21T07:56:26.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c90cede6-63fb-44eb-9ebe-f3dcb5141c23 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
112992024-12-21T07:56:26.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c90cede6-63fb-44eb-9ebe-f3dcb5141c23 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
113002024-12-21T07:56:26.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c90cede6-63fb-44eb-9ebe-f3dcb5141c23 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
113012024-12-21T07:56:27.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 11952fcf-b4b9-49fa-9133-7223858100e0 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
113022024-12-21T07:56:27.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 11952fcf-b4b9-49fa-9133-7223858100e0 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
113032024-12-21T07:56:27.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2748 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 11952fcf-b4b9-49fa-9133-7223858100e0 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
113042024-12-21T07:56:28.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ac7630ad-490f-4353-a116-aa23742eb79f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
113052024-12-21T07:56:28.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ac7630ad-490f-4353-a116-aa23742eb79f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
113062024-12-21T07:56:28.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ac7630ad-490f-4353-a116-aa23742eb79f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
113072024-12-21T07:56:29.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cdc7371c-88d4-4827-b71b-5ffc8d432003 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
113082024-12-21T07:56:29.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cdc7371c-88d4-4827-b71b-5ffc8d432003 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
113092024-12-21T07:56:29.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cdc7371c-88d4-4827-b71b-5ffc8d432003 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
113102024-12-21T07:56:29.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1383 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 6d7d71db-14ab-47a7-bb88-f0e68ef7b378 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
113112024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
113122024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
113132024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
113142024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
113152024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
113162024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113172024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
113182024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
113192024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113202024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
113212024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
113222024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
113232024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113242024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
113252024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
113262024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
113272024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
113282024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
113292024-12-21T07:56:30.667ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
113302024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113312024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
113322024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
113332024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113342024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
113352024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
113362024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
113372024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113382024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
113392024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
113402024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
113412024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113422024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
113432024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
113442024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
113452024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113462024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
113472024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113482024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113492024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
113502024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
113512024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113522024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113532024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
113542024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
113552024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
113562024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
113572024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113582024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
113592024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113602024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113612024-12-21T07:56:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113622024-12-21T07:56:30.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5e68ea57-3811-4646-a985-3fe8a60185aa roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
113632024-12-21T07:56:30.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5e68ea57-3811-4646-a985-3fe8a60185aa resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
113642024-12-21T07:56:30.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113652024-12-21T07:56:30.671ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.971286ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
113662024-12-21T07:56:30.671ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113672024-12-21T07:56:30.671ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1724, tv_nsec: 370096311 } })
113682024-12-21T07:56:30.671ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
113692024-12-21T07:56:30.672ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
113702024-12-21T07:56:30.672ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113712024-12-21T07:56:30.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113722024-12-21T07:56:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
113732024-12-21T07:56:30.673ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
113742024-12-21T07:56:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
113752024-12-21T07:56:30.680ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1724, tv_nsec: 378746845 } })
113762024-12-21T07:56:30.680ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
113772024-12-21T07:56:30.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113782024-12-21T07:56:30.681ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113792024-12-21T07:56:30.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
113802024-12-21T07:56:30.684ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113812024-12-21T07:56:30.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113822024-12-21T07:56:30.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5e68ea57-3811-4646-a985-3fe8a60185aa response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
113832024-12-21T07:56:30.685ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
113842024-12-21T07:56:30.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113852024-12-21T07:56:30.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113862024-12-21T07:56:30.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113872024-12-21T07:56:30.689ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113882024-12-21T07:56:30.689ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
113892024-12-21T07:56:30.689ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113902024-12-21T07:56:30.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113912024-12-21T07:56:30.689ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1724, tv_nsec: 388209622 } })
113922024-12-21T07:56:30.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113932024-12-21T07:56:30.690ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
113942024-12-21T07:56:30.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 38.192826ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
113952024-12-21T07:56:30.706ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
113962024-12-21T07:56:30.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
113972024-12-21T07:56:30.707ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 40.2101ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
113982024-12-21T07:56:30.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113992024-12-21T07:56:30.711ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114002024-12-21T07:56:30.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114012024-12-21T07:56:30.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114022024-12-21T07:56:30.712ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
114032024-12-21T07:56:30.712ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
114042024-12-21T07:56:30.712ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114052024-12-21T07:56:30.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114062024-12-21T07:56:30.713ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114072024-12-21T07:56:30.713ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114082024-12-21T07:56:30.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114092024-12-21T07:56:30.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114102024-12-21T07:56:30.713ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114112024-12-21T07:56:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
114122024-12-21T07:56:30.714ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114132024-12-21T07:56:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114142024-12-21T07:56:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114152024-12-21T07:56:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114162024-12-21T07:56:30.714ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114172024-12-21T07:56:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114182024-12-21T07:56:30.717ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 50.157334ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
114192024-12-21T07:56:30.721ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114202024-12-21T07:56:30.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
114212024-12-21T07:56:30.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114222024-12-21T07:56:30.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
114232024-12-21T07:56:30.722ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
114242024-12-21T07:56:30.722ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 55.718127ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
114252024-12-21T07:56:30.723ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114262024-12-21T07:56:30.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114272024-12-21T07:56:30.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114282024-12-21T07:56:30.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114292024-12-21T07:56:30.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114302024-12-21T07:56:30.725ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114312024-12-21T07:56:30.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114322024-12-21T07:56:30.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
114332024-12-21T07:56:30.728ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114342024-12-21T07:56:30.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114352024-12-21T07:56:30.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
114362024-12-21T07:56:30.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114372024-12-21T07:56:30.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
114382024-12-21T07:56:30.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114392024-12-21T07:56:30.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114402024-12-21T07:56:30.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114412024-12-21T07:56:30.731ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 64.245359ms iteration = 28 status = 0
114422024-12-21T07:56:30.742ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
114432024-12-21T07:56:30.742ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.216832ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
114442024-12-21T07:56:30.743ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 75.943534ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
114452024-12-21T07:56:30.747ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
114462024-12-21T07:56:30.747ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
114472024-12-21T07:56:30.747ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114482024-12-21T07:56:30.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114492024-12-21T07:56:30.748ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.369954ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
114502024-12-21T07:56:30.749ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.541583ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
114512024-12-21T07:56:30.769ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
114522024-12-21T07:56:30.769ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114532024-12-21T07:56:30.770ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee6adf98-f036-4bdd-a0e5-81f355a361d4", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:30 GMT"} })
114542024-12-21T07:56:30.770ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114552024-12-21T07:56:30.772ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114562024-12-21T07:56:30.775ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
114572024-12-21T07:56:30.775ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114582024-12-21T07:56:30.775ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a616584a-a35c-4945-9bd0-236799bbe8dc", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:30 GMT"} })
114592024-12-21T07:56:30.775ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114602024-12-21T07:56:30.777ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114612024-12-21T07:56:30.779ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
114622024-12-21T07:56:30.779ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
114632024-12-21T07:56:30.779ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 112.694526ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
114642024-12-21T07:56:30.788ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114652024-12-21T07:56:30.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114662024-12-21T07:56:30.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114672024-12-21T07:56:30.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114682024-12-21T07:56:30.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114692024-12-21T07:56:30.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114702024-12-21T07:56:30.808ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114712024-12-21T07:56:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114722024-12-21T07:56:30.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114732024-12-21T07:56:30.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114742024-12-21T07:56:30.812ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114752024-12-21T07:56:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114762024-12-21T07:56:30.849ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
114772024-12-21T07:56:30.849ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114782024-12-21T07:56:30.850ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f8be110-adcb-4d04-833c-160a80e3acec", "content-length": "26", "date": "Sat, 21 Dec 2024 07:56:30 GMT"} })
114792024-12-21T07:56:30.850ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114802024-12-21T07:56:30.851ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
114812024-12-21T07:56:30.856ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 189.483442ms iteration = 32 status = {"physical_disks_added":0}
114822024-12-21T07:56:30.893ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
114832024-12-21T07:56:30.893ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114842024-12-21T07:56:30.894ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd90e4ae-fd0d-456e-b9ef-5dfdca76501a", "content-length": "372", "date": "Sat, 21 Dec 2024 07:56:29 GMT"} })
114852024-12-21T07:56:30.894ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114862024-12-21T07:56:30.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114872024-12-21T07:56:30.908ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
114882024-12-21T07:56:30.908ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
114892024-12-21T07:56:30.909ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "146e2f80-4d5e-4a17-88e4-6dbc5123c3e5", "date": "Sat, 21 Dec 2024 07:56:30 GMT"} })
114902024-12-21T07:56:30.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114912024-12-21T07:56:30.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114922024-12-21T07:56:30.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114932024-12-21T07:56:30.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114942024-12-21T07:56:30.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114952024-12-21T07:56:30.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114962024-12-21T07:56:30.918ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
114972024-12-21T07:56:30.918ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114982024-12-21T07:56:30.919ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3b9c526b-2387-445d-9d6e-7d9307e1cb45", "date": "Sat, 21 Dec 2024 07:56:30 GMT"} })
114992024-12-21T07:56:30.920ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 253.431377ms iteration = 30 status = {}
115002024-12-21T07:56:31.034ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
115012024-12-21T07:56:31.034ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4cfbc28-b1d8-47da-9c9d-552884e445e4", "content-length": "691", "date": "Sat, 21 Dec 2024 07:56:30 GMT"} })
115022024-12-21T07:56:31.034ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
115032024-12-21T07:56:31.034ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
115042024-12-21T07:56:31.034ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
115052024-12-21T07:56:31.035ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 368.40522ms iteration = 29 status = {}
115062024-12-21T07:56:31.055ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 388.133608ms iteration = 28 status = {}
115072024-12-21T07:56:31.056ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
115082024-12-21T07:56:31.056ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3edce1f-3bb3-4fe7-8656-f40c4c40c1aa", "content-length": "2", "date": "Sat, 21 Dec 2024 07:56:30 GMT"} })
115092024-12-21T07:56:31.058ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
115102024-12-21T07:56:31.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
115112024-12-21T07:56:31.060ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 393.180252ms iteration = 28 status = null
115122024-12-21T07:56:31.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115132024-12-21T07:56:31.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115142024-12-21T07:56:31.101ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
115152024-12-21T07:56:31.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115162024-12-21T07:56:31.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115172024-12-21T07:56:31.111ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
115182024-12-21T07:56:31.111ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e02b29f-88a1-41ad-b087-bf7589d8b8d4", "content-length": "134", "date": "Sat, 21 Dec 2024 07:56:30 GMT"} })
115192024-12-21T07:56:31.111ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
115202024-12-21T07:56:31.111ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
115212024-12-21T07:56:31.111ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
115222024-12-21T07:56:31.111ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
115232024-12-21T07:56:31.111ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115242024-12-21T07:56:31.111ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115252024-12-21T07:56:31.111ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115262024-12-21T07:56:31.111ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115272024-12-21T07:56:31.111ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115282024-12-21T07:56:31.111ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115292024-12-21T07:56:31.112ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
115302024-12-21T07:56:31.112ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115312024-12-21T07:56:31.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115322024-12-21T07:56:31.113ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
115332024-12-21T07:56:31.114ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3137e7d-67b1-4a52-bf7d-6f73feb47d15", "content-length": "2", "date": "Sat, 21 Dec 2024 07:56:30 GMT"} })
115342024-12-21T07:56:31.114ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
115352024-12-21T07:56:31.114ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cab87e8a-648a-4e22-baad-763de1d1e799", "content-length": "52", "date": "Sat, 21 Dec 2024 07:56:30 GMT"} })
115362024-12-21T07:56:31.114ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
115372024-12-21T07:56:31.114ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
115382024-12-21T07:56:31.232ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ad9902e1-43e1-4d47-973b-79db531193f5", "date": "Sat, 21 Dec 2024 07:56:31 GMT"} })
115392024-12-21T07:56:31.232ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
115402024-12-21T07:56:31.232ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
115412024-12-21T07:56:31.232ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d068b417-a669-43da-9f78-acc3ab5339fa", "content-length": "682", "date": "Sat, 21 Dec 2024 07:56:31 GMT"} })
115422024-12-21T07:56:31.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115432024-12-21T07:56:31.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115442024-12-21T07:56:31.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115452024-12-21T07:56:31.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115462024-12-21T07:56:31.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115472024-12-21T07:56:31.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115482024-12-21T07:56:31.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115492024-12-21T07:56:31.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115502024-12-21T07:56:31.248ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 580.929606ms iteration = 28 status = {}
115512024-12-21T07:56:31.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 858a9966-1180-4197-946f-3fae37f3cc0c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115522024-12-21T07:56:31.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 858a9966-1180-4197-946f-3fae37f3cc0c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115532024-12-21T07:56:31.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 858a9966-1180-4197-946f-3fae37f3cc0c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115542024-12-21T07:56:32.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eb4dcc24-29fb-4d8b-bf73-dfdc2168fcbb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115552024-12-21T07:56:32.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eb4dcc24-29fb-4d8b-bf73-dfdc2168fcbb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115562024-12-21T07:56:32.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = eb4dcc24-29fb-4d8b-bf73-dfdc2168fcbb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115572024-12-21T07:56:33.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a41957ce-f80d-4020-9a79-94337d0f6e2f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115582024-12-21T07:56:33.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a41957ce-f80d-4020-9a79-94337d0f6e2f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115592024-12-21T07:56:33.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2586 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a41957ce-f80d-4020-9a79-94337d0f6e2f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115602024-12-21T07:56:34.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = f067ea19-5bf4-48f3-a4e4-41865a8095de roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
115612024-12-21T07:56:34.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = f067ea19-5bf4-48f3-a4e4-41865a8095de resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
115622024-12-21T07:56:34.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = f067ea19-5bf4-48f3-a4e4-41865a8095de response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
115632024-12-21T07:56:34.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 391fb617-5bbe-4fb8-82cc-030dbb90926d roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
115642024-12-21T07:56:34.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 391fb617-5bbe-4fb8-82cc-030dbb90926d resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
115652024-12-21T07:56:34.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2684 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 391fb617-5bbe-4fb8-82cc-030dbb90926d response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
115662024-12-21T07:56:34.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7b40d5b-49ff-4c0c-9cf2-b2c20ca2c5db roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115672024-12-21T07:56:34.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7b40d5b-49ff-4c0c-9cf2-b2c20ca2c5db resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115682024-12-21T07:56:34.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b7b40d5b-49ff-4c0c-9cf2-b2c20ca2c5db response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115692024-12-21T07:56:35.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 961e60a5-dfe8-4307-adb3-2c588e24220d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115702024-12-21T07:56:35.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 961e60a5-dfe8-4307-adb3-2c588e24220d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115712024-12-21T07:56:35.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2574 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 961e60a5-dfe8-4307-adb3-2c588e24220d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115722024-12-21T07:56:36.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 842df7b3-5a2c-4de7-a423-1975a488bede roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115732024-12-21T07:56:36.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 842df7b3-5a2c-4de7-a423-1975a488bede resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115742024-12-21T07:56:36.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 842df7b3-5a2c-4de7-a423-1975a488bede response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115752024-12-21T07:56:37.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e8ec819a-ded6-4048-ab6f-2f33cb88cafa roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115762024-12-21T07:56:37.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e8ec819a-ded6-4048-ab6f-2f33cb88cafa resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115772024-12-21T07:56:37.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e8ec819a-ded6-4048-ab6f-2f33cb88cafa response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115782024-12-21T07:56:38.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 12d45c77-3569-454e-a6ac-90cf4157bf25 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115792024-12-21T07:56:38.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 12d45c77-3569-454e-a6ac-90cf4157bf25 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115802024-12-21T07:56:38.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2898 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 12d45c77-3569-454e-a6ac-90cf4157bf25 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115812024-12-21T07:56:39.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1493 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 3a80a387-b17e-4baf-99b3-936ed949ae45 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
115822024-12-21T07:56:39.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bdcb93bc-0423-4aa1-a009-f841cc10dd2e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115832024-12-21T07:56:39.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bdcb93bc-0423-4aa1-a009-f841cc10dd2e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115842024-12-21T07:56:39.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bdcb93bc-0423-4aa1-a009-f841cc10dd2e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
115852024-12-21T07:56:40.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
115862024-12-21T07:56:40.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
115872024-12-21T07:56:40.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115882024-12-21T07:56:40.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115892024-12-21T07:56:40.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115902024-12-21T07:56:40.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115912024-12-21T07:56:40.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115922024-12-21T07:56:40.669ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115932024-12-21T07:56:40.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115942024-12-21T07:56:40.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.26592ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
115952024-12-21T07:56:40.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
115962024-12-21T07:56:40.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115972024-12-21T07:56:40.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115982024-12-21T07:56:40.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115992024-12-21T07:56:40.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116002024-12-21T07:56:40.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116012024-12-21T07:56:40.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
116022024-12-21T07:56:40.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116032024-12-21T07:56:40.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116042024-12-21T07:56:40.690ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
116052024-12-21T07:56:40.690ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.099574ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
116062024-12-21T07:56:40.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 48cb5b28-d0e6-4304-90a9-d6d6a0019b54 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116072024-12-21T07:56:40.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 48cb5b28-d0e6-4304-90a9-d6d6a0019b54 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116082024-12-21T07:56:40.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 48cb5b28-d0e6-4304-90a9-d6d6a0019b54 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116092024-12-21T07:56:41.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 778f65c5-7035-45c2-ace6-68a40a2fc258 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116102024-12-21T07:56:41.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 778f65c5-7035-45c2-ace6-68a40a2fc258 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116112024-12-21T07:56:41.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 778f65c5-7035-45c2-ace6-68a40a2fc258 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116122024-12-21T07:56:42.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6912add6-8610-4e90-94db-14c1d48e32df roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116132024-12-21T07:56:42.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6912add6-8610-4e90-94db-14c1d48e32df resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116142024-12-21T07:56:42.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2689 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6912add6-8610-4e90-94db-14c1d48e32df response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116152024-12-21T07:56:43.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 83034a50-f617-4fad-bb2f-b4d1cb74631f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116162024-12-21T07:56:43.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 83034a50-f617-4fad-bb2f-b4d1cb74631f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116172024-12-21T07:56:43.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 83034a50-f617-4fad-bb2f-b4d1cb74631f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116182024-12-21T07:56:44.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3e6bb713-ee6a-468b-b698-baa090a873ea roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116192024-12-21T07:56:44.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3e6bb713-ee6a-468b-b698-baa090a873ea resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116202024-12-21T07:56:44.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3e6bb713-ee6a-468b-b698-baa090a873ea response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116212024-12-21T07:56:46.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a12c744b-f07d-4c89-9ade-1c3096bf7ae4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116222024-12-21T07:56:46.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a12c744b-f07d-4c89-9ade-1c3096bf7ae4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116232024-12-21T07:56:46.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a12c744b-f07d-4c89-9ade-1c3096bf7ae4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116242024-12-21T07:56:46.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = fb7b34f1-acdf-408e-bfb2-892fc63e2f80 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
116252024-12-21T07:56:46.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = fb7b34f1-acdf-408e-bfb2-892fc63e2f80 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
116262024-12-21T07:56:46.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3723 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = fb7b34f1-acdf-408e-bfb2-892fc63e2f80 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
116272024-12-21T07:56:47.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a453081f-831e-4844-86fb-a324b942af9d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116282024-12-21T07:56:47.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a453081f-831e-4844-86fb-a324b942af9d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116292024-12-21T07:56:47.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a453081f-831e-4844-86fb-a324b942af9d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116302024-12-21T07:56:48.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5afa747b-60a5-47f5-bc61-2e9d6ac75b2e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116312024-12-21T07:56:48.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5afa747b-60a5-47f5-bc61-2e9d6ac75b2e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116322024-12-21T07:56:48.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5afa747b-60a5-47f5-bc61-2e9d6ac75b2e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116332024-12-21T07:56:49.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c2d2ad81-ddf0-4ba6-aab1-720940042e0d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116342024-12-21T07:56:49.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c2d2ad81-ddf0-4ba6-aab1-720940042e0d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116352024-12-21T07:56:49.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2639 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c2d2ad81-ddf0-4ba6-aab1-720940042e0d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116362024-12-21T07:56:49.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1509 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 4ea80b3c-e4bc-4205-8a0a-697d520a88e4 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
116372024-12-21T07:56:50.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dfd33095-87ae-4c5c-9a8d-b220fb65f2b3 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116382024-12-21T07:56:50.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dfd33095-87ae-4c5c-9a8d-b220fb65f2b3 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116392024-12-21T07:56:50.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2808 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dfd33095-87ae-4c5c-9a8d-b220fb65f2b3 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116402024-12-21T07:56:50.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
116412024-12-21T07:56:50.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
116422024-12-21T07:56:50.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116432024-12-21T07:56:50.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116442024-12-21T07:56:50.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116452024-12-21T07:56:50.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116462024-12-21T07:56:50.670ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116472024-12-21T07:56:50.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116482024-12-21T07:56:50.694ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116492024-12-21T07:56:50.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116502024-12-21T07:56:50.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116512024-12-21T07:56:50.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116522024-12-21T07:56:50.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.911254ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116532024-12-21T07:56:50.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116542024-12-21T07:56:50.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116552024-12-21T07:56:50.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116562024-12-21T07:56:50.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
116572024-12-21T07:56:50.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116582024-12-21T07:56:50.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116592024-12-21T07:56:50.714ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
116602024-12-21T07:56:50.714ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.106433ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
116612024-12-21T07:56:51.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 01aef56d-b215-4b01-9316-e92d448fbe13 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116622024-12-21T07:56:51.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 01aef56d-b215-4b01-9316-e92d448fbe13 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116632024-12-21T07:56:51.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 01aef56d-b215-4b01-9316-e92d448fbe13 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116642024-12-21T07:56:52.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 49ebebd4-f2e6-4a05-8fb9-449ac3841d53 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116652024-12-21T07:56:52.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 49ebebd4-f2e6-4a05-8fb9-449ac3841d53 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116662024-12-21T07:56:52.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 49ebebd4-f2e6-4a05-8fb9-449ac3841d53 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116672024-12-21T07:56:53.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5d1bf703-d2cc-4228-ad6a-01cb941d7ef3 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116682024-12-21T07:56:53.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5d1bf703-d2cc-4228-ad6a-01cb941d7ef3 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116692024-12-21T07:56:53.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2416 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 5d1bf703-d2cc-4228-ad6a-01cb941d7ef3 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116702024-12-21T07:56:54.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 88b663ca-d314-40c9-afb4-3ffd196e1354 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116712024-12-21T07:56:54.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 88b663ca-d314-40c9-afb4-3ffd196e1354 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116722024-12-21T07:56:54.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 88b663ca-d314-40c9-afb4-3ffd196e1354 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116732024-12-21T07:56:55.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f5aa1bd6-8e46-4e5f-a69b-9cc97bfcc0ed roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116742024-12-21T07:56:55.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f5aa1bd6-8e46-4e5f-a69b-9cc97bfcc0ed resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116752024-12-21T07:56:55.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2533 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f5aa1bd6-8e46-4e5f-a69b-9cc97bfcc0ed response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116762024-12-21T07:56:56.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 28813ff6-d14d-4d77-bfd0-e56428495f7d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116772024-12-21T07:56:56.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 28813ff6-d14d-4d77-bfd0-e56428495f7d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116782024-12-21T07:56:56.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 28813ff6-d14d-4d77-bfd0-e56428495f7d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116792024-12-21T07:56:57.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 231b59af-cefa-4442-81a2-453066aa2fe0 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116802024-12-21T07:56:57.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 231b59af-cefa-4442-81a2-453066aa2fe0 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116812024-12-21T07:56:57.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 231b59af-cefa-4442-81a2-453066aa2fe0 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116822024-12-21T07:56:58.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e4c7ff52-89cd-4156-9d12-e289cf4e6f35 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116832024-12-21T07:56:58.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e4c7ff52-89cd-4156-9d12-e289cf4e6f35 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116842024-12-21T07:56:58.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e4c7ff52-89cd-4156-9d12-e289cf4e6f35 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116852024-12-21T07:56:59.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3e9f070c-1094-4d39-ab79-a2bdf9432319 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116862024-12-21T07:56:59.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3e9f070c-1094-4d39-ab79-a2bdf9432319 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116872024-12-21T07:56:59.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3e9f070c-1094-4d39-ab79-a2bdf9432319 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116882024-12-21T07:56:59.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1440 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 59ba321d-ea33-49ad-8db8-e06c1635ef05 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
116892024-12-21T07:57:00.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3910bd81-5c82-4473-aeb6-4ef8f033e71e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116902024-12-21T07:57:00.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3910bd81-5c82-4473-aeb6-4ef8f033e71e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116912024-12-21T07:57:00.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3910bd81-5c82-4473-aeb6-4ef8f033e71e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
116922024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
116932024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
116942024-12-21T07:57:00.667ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
116952024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
116962024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
116972024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
116982024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
116992024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
117002024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117012024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
117022024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
117032024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117042024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
117052024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
117062024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
117072024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
117082024-12-21T07:57:00.667ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
117092024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
117102024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117112024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
117122024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
117132024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
117142024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
117152024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117162024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
117172024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
117182024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
117192024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
117202024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
117212024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
117222024-12-21T07:57:00.667ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b
117232024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
117242024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.74\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b"}
117252024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117262024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117272024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
117282024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
117292024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
117302024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
117312024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
117322024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117332024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
117342024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
117352024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117362024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
117372024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
117382024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
117392024-12-21T07:57:00.667ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:47:00.667541650 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
117402024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
117412024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
117422024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
117432024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
117442024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
117452024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
117462024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
117472024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117482024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
117492024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
117502024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117512024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
117522024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
117532024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
117542024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
117552024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
117562024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117572024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117582024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
117592024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117602024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
117612024-12-21T07:57:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
117622024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
117632024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117642024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117652024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
117662024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
117672024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117682024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117692024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117702024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
117712024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
117722024-12-21T07:57:00.668ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bfae345-1659-4377-bca9-c55abec2aeb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7c426166-4f75-4a87-b9ac-c0d590aea49b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1754, tv_nsec: 366593856 } })
117732024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117742024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
117752024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
117762024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
117772024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117782024-12-21T07:57:00.668ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dd95bbd-e009-486c-8c96-451a6e195a49.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1754, tv_nsec: 366666647 } })
117792024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
117802024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
117812024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.136569ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
117822024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
117832024-12-21T07:57:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.340142ms iteration = 16 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
117842024-12-21T07:57:00.670ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117852024-12-21T07:57:00.670ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.743423ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
117862024-12-21T07:57:00.671ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117872024-12-21T07:57:00.671ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117882024-12-21T07:57:00.671ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.005767ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
117892024-12-21T07:57:00.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117902024-12-21T07:57:00.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
117912024-12-21T07:57:00.672ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
117922024-12-21T07:57:00.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
117932024-12-21T07:57:00.673ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
117942024-12-21T07:57:00.673ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117952024-12-21T07:57:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117962024-12-21T07:57:00.674ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117972024-12-21T07:57:00.675ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1754, tv_nsec: 373905888 } })
117982024-12-21T07:57:00.675ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
117992024-12-21T07:57:00.675ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118002024-12-21T07:57:00.676ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118012024-12-21T07:57:00.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118022024-12-21T07:57:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118032024-12-21T07:57:00.677ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
118042024-12-21T07:57:00.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
118052024-12-21T07:57:00.677ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118062024-12-21T07:57:00.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
118072024-12-21T07:57:00.678ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118082024-12-21T07:57:00.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118092024-12-21T07:57:00.679ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118102024-12-21T07:57:00.679ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
118112024-12-21T07:57:00.679ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
118122024-12-21T07:57:00.679ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 12.438267ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
118132024-12-21T07:57:00.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
118142024-12-21T07:57:00.680ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118152024-12-21T07:57:00.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118162024-12-21T07:57:00.681ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118172024-12-21T07:57:00.681ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118182024-12-21T07:57:00.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
118192024-12-21T07:57:00.682ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118202024-12-21T07:57:00.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118212024-12-21T07:57:00.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118222024-12-21T07:57:00.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118232024-12-21T07:57:00.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
118242024-12-21T07:57:00.684ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
118252024-12-21T07:57:00.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
118262024-12-21T07:57:00.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
118272024-12-21T07:57:00.685ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118282024-12-21T07:57:00.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118292024-12-21T07:57:00.685ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:47:00.667541650 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
118302024-12-21T07:57:00.685ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.622634ms iteration = 15 status = {"expiration":"2024-12-21T07:47:00.667541650Z","pruned":[]}
118312024-12-21T07:57:00.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118322024-12-21T07:57:00.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118332024-12-21T07:57:00.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 19.347502ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
118342024-12-21T07:57:00.686ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1754, tv_nsec: 385430340 } })
118352024-12-21T07:57:00.687ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
118362024-12-21T07:57:00.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 20.393339ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118372024-12-21T07:57:00.689ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
118382024-12-21T07:57:00.689ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 22.058667ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
118392024-12-21T07:57:00.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118402024-12-21T07:57:00.690ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118412024-12-21T07:57:00.690ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1754, tv_nsec: 389325455 } })
118422024-12-21T07:57:00.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118432024-12-21T07:57:00.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118442024-12-21T07:57:00.691ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
118452024-12-21T07:57:00.691ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118462024-12-21T07:57:00.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118472024-12-21T07:57:00.691ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118482024-12-21T07:57:00.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118492024-12-21T07:57:00.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
118502024-12-21T07:57:00.695ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118512024-12-21T07:57:00.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118522024-12-21T07:57:00.697ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
118532024-12-21T07:57:00.697ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 29.730275ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
118542024-12-21T07:57:00.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
118552024-12-21T07:57:00.698ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118562024-12-21T07:57:00.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118572024-12-21T07:57:00.700ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
118582024-12-21T07:57:00.700ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118592024-12-21T07:57:00.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118602024-12-21T07:57:00.702ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
118612024-12-21T07:57:00.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
118622024-12-21T07:57:00.707ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
118632024-12-21T07:57:00.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
118642024-12-21T07:57:00.713ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 46.124547ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
118652024-12-21T07:57:00.717ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.066413ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
118662024-12-21T07:57:00.723ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
118672024-12-21T07:57:00.723ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.737837ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
118682024-12-21T07:57:00.723ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
118692024-12-21T07:57:00.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
118702024-12-21T07:57:00.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.774058ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
118712024-12-21T07:57:00.728ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
118722024-12-21T07:57:00.728ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
118732024-12-21T07:57:00.728ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 60.929164ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
118742024-12-21T07:57:00.730ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118752024-12-21T07:57:00.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118762024-12-21T07:57:00.732ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118772024-12-21T07:57:00.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118782024-12-21T07:57:00.734ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118792024-12-21T07:57:00.735ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118802024-12-21T07:57:00.735ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
118812024-12-21T07:57:00.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118822024-12-21T07:57:00.735ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
118832024-12-21T07:57:00.735ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
118842024-12-21T07:57:00.735ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
118852024-12-21T07:57:00.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118862024-12-21T07:57:00.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118872024-12-21T07:57:00.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118882024-12-21T07:57:00.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118892024-12-21T07:57:00.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
118902024-12-21T07:57:00.736ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118912024-12-21T07:57:00.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118922024-12-21T07:57:00.737ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118932024-12-21T07:57:00.737ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118942024-12-21T07:57:00.737ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
118952024-12-21T07:57:00.737ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118962024-12-21T07:57:00.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118972024-12-21T07:57:00.738ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 71.189344ms iteration = 29 status = 0
118982024-12-21T07:57:00.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118992024-12-21T07:57:00.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119002024-12-21T07:57:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119012024-12-21T07:57:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
119022024-12-21T07:57:00.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
119032024-12-21T07:57:00.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
119042024-12-21T07:57:00.745ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119052024-12-21T07:57:00.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119062024-12-21T07:57:00.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
119072024-12-21T07:57:00.749ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
119082024-12-21T07:57:00.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
119092024-12-21T07:57:00.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
119102024-12-21T07:57:00.756ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
119112024-12-21T07:57:00.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
119122024-12-21T07:57:00.771ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
119132024-12-21T07:57:00.771ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
119142024-12-21T07:57:00.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
119152024-12-21T07:57:00.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
119162024-12-21T07:57:00.771ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
119172024-12-21T07:57:00.772ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
119182024-12-21T07:57:00.772ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.380966ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
119192024-12-21T07:57:00.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119202024-12-21T07:57:00.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
119212024-12-21T07:57:00.775ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
119222024-12-21T07:57:00.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
119232024-12-21T07:57:00.775ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
119242024-12-21T07:57:00.775ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
119252024-12-21T07:57:00.775ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
119262024-12-21T07:57:00.775ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119272024-12-21T07:57:00.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119282024-12-21T07:57:00.777ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119292024-12-21T07:57:00.778ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
119302024-12-21T07:57:00.778ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
119312024-12-21T07:57:00.778ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:43:39.444085 UTC dns_group = internal generation = 1
119322024-12-21T07:57:00.778ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 110.668341ms iteration = 16 status = {"generation":1}
119332024-12-21T07:57:00.779ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
119342024-12-21T07:57:00.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
119352024-12-21T07:57:00.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
119362024-12-21T07:57:00.780ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119372024-12-21T07:57:00.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119382024-12-21T07:57:00.781ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119392024-12-21T07:57:00.783ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
119402024-12-21T07:57:00.783ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
119412024-12-21T07:57:00.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
119422024-12-21T07:57:00.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119432024-12-21T07:57:00.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119442024-12-21T07:57:00.794ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
119452024-12-21T07:57:00.801ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
119462024-12-21T07:57:00.825ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
119472024-12-21T07:57:00.825ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119482024-12-21T07:57:00.826ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 158.64644ms iteration = 33 status = {"physical_disks_added":0}
119492024-12-21T07:57:00.826ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50a257d4-d80e-4d50-bcba-91439575e256", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:00 GMT"} })
119502024-12-21T07:57:00.826ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
119512024-12-21T07:57:00.830ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
119522024-12-21T07:57:00.833ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
119532024-12-21T07:57:00.833ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
119542024-12-21T07:57:00.833ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 0 version = 2
119552024-12-21T07:57:00.833ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119562024-12-21T07:57:00.833ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119572024-12-21T07:57:00.835ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c4298ea-8bda-4124-8f07-371090b57280", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:00 GMT"} })
119582024-12-21T07:57:00.836ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
119592024-12-21T07:57:00.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119602024-12-21T07:57:00.837ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
119612024-12-21T07:57:00.849ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:42:50.264108Z, time_modified: 2024-12-21T07:42:50.264108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }) }
119622024-12-21T07:57:00.849ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 181.861846ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]}},"default_endpoint":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
119632024-12-21T07:57:00.862ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
119642024-12-21T07:57:00.863ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119652024-12-21T07:57:00.863ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "732c9ad8-c314-4b50-862f-3d23f5d385c9", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:00 GMT"} })
119662024-12-21T07:57:00.863ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
119672024-12-21T07:57:00.865ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
119682024-12-21T07:57:00.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119692024-12-21T07:57:00.875ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
119702024-12-21T07:57:00.875ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 208.018671ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
119712024-12-21T07:57:00.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
119722024-12-21T07:57:00.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119732024-12-21T07:57:00.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119742024-12-21T07:57:00.880ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 1 version = 2
119752024-12-21T07:57:00.880ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
119762024-12-21T07:57:00.880ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:43:41.075205 UTC dns_group = external generation = 2
119772024-12-21T07:57:00.880ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 212.664368ms iteration = 16 status = {"generation":2}
119782024-12-21T07:57:00.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119792024-12-21T07:57:00.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119802024-12-21T07:57:00.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119812024-12-21T07:57:00.925ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
119822024-12-21T07:57:00.925ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119832024-12-21T07:57:00.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119842024-12-21T07:57:00.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119852024-12-21T07:57:00.929ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
119862024-12-21T07:57:00.929ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119872024-12-21T07:57:00.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119882024-12-21T07:57:00.970ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
119892024-12-21T07:57:00.970ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
119902024-12-21T07:57:00.971ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "af6e8cdf-bbe8-4ecc-b84b-bf25f0b10452", "content-length": "372", "date": "Sat, 21 Dec 2024 07:57:00 GMT"} })
119912024-12-21T07:57:00.971ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119922024-12-21T07:57:00.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119932024-12-21T07:57:00.979ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
119942024-12-21T07:57:00.987ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 320.331041ms iteration = 29 status = {}
119952024-12-21T07:57:00.990ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
119962024-12-21T07:57:00.991ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "67db5d7a-9995-466b-a707-d1eccda0d4c6", "date": "Sat, 21 Dec 2024 07:57:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
119972024-12-21T07:57:00.991ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
119982024-12-21T07:57:00.993ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "93fe794d-2b8f-428c-b89d-7da23323d5a7", "date": "Sat, 21 Dec 2024 07:57:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
119992024-12-21T07:57:00.993ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
120002024-12-21T07:57:00.994ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
120012024-12-21T07:57:00.994ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 327.067722ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
120022024-12-21T07:57:01.014ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
120032024-12-21T07:57:01.014ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
120042024-12-21T07:57:01.014ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cc347072-c960-4b0f-aa25-a952cb199681", "date": "Sat, 21 Dec 2024 07:57:00 GMT"} })
120052024-12-21T07:57:01.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120062024-12-21T07:57:01.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120072024-12-21T07:57:01.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120082024-12-21T07:57:01.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120092024-12-21T07:57:01.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120102024-12-21T07:57:01.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120112024-12-21T07:57:01.023ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
120122024-12-21T07:57:01.023ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b258108f-aca7-43b0-b98f-6fb566c9da4e", "content-length": "2", "date": "Sat, 21 Dec 2024 07:57:00 GMT"} })
120132024-12-21T07:57:01.023ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
120142024-12-21T07:57:01.023ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
120152024-12-21T07:57:01.024ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4c9804a0-5a08-433b-83bd-0ecba7aacf10", "date": "Sat, 21 Dec 2024 07:57:00 GMT"} })
120162024-12-21T07:57:01.024ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
120172024-12-21T07:57:01.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
120182024-12-21T07:57:01.026ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 359.521982ms iteration = 31 status = {}
120192024-12-21T07:57:01.050ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
120202024-12-21T07:57:01.051ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcd644b5-b306-4dd0-89e5-42960f08e310", "content-length": "691", "date": "Sat, 21 Dec 2024 07:57:00 GMT"} })
120212024-12-21T07:57:01.051ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
120222024-12-21T07:57:01.051ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
120232024-12-21T07:57:01.051ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
120242024-12-21T07:57:01.052ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 385.061496ms iteration = 30 status = {}
120252024-12-21T07:57:01.052ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 385.342441ms iteration = 29 status = null
120262024-12-21T07:57:01.067ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
120272024-12-21T07:57:01.067ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8098982e-85b3-4a4b-bc95-4797768721ed", "date": "Sat, 21 Dec 2024 07:57:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
120282024-12-21T07:57:01.067ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
120292024-12-21T07:57:01.070ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3c25324b-ff0e-4091-9d03-b31498f75ef6", "date": "Sat, 21 Dec 2024 07:57:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
120302024-12-21T07:57:01.070ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
120312024-12-21T07:57:01.072ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "08445a96-4f87-4390-91ed-9767fff71443", "date": "Sat, 21 Dec 2024 07:57:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
120322024-12-21T07:57:01.072ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
120332024-12-21T07:57:01.073ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
120342024-12-21T07:57:01.073ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 406.509203ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
120352024-12-21T07:57:01.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120362024-12-21T07:57:01.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120372024-12-21T07:57:01.108ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
120382024-12-21T07:57:01.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120392024-12-21T07:57:01.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120402024-12-21T07:57:01.118ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
120412024-12-21T07:57:01.118ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee01fed8-0e0c-410e-a104-3f70788fb371", "content-length": "134", "date": "Sat, 21 Dec 2024 07:57:00 GMT"} })
120422024-12-21T07:57:01.118ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
120432024-12-21T07:57:01.118ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
120442024-12-21T07:57:01.118ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
120452024-12-21T07:57:01.118ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
120462024-12-21T07:57:01.118ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120472024-12-21T07:57:01.118ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120482024-12-21T07:57:01.118ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120492024-12-21T07:57:01.118ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
120502024-12-21T07:57:01.119ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120512024-12-21T07:57:01.119ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
120522024-12-21T07:57:01.119ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
120532024-12-21T07:57:01.119ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120542024-12-21T07:57:01.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120552024-12-21T07:57:01.121ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
120562024-12-21T07:57:01.121ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6a5f202-51aa-4985-9fcd-ca3a03e62f05", "content-length": "2", "date": "Sat, 21 Dec 2024 07:57:00 GMT"} })
120572024-12-21T07:57:01.121ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
120582024-12-21T07:57:01.121ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4833222-2f9c-48b4-9742-125c423b37b6", "content-length": "52", "date": "Sat, 21 Dec 2024 07:57:00 GMT"} })
120592024-12-21T07:57:01.121ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
120602024-12-21T07:57:01.121ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
120612024-12-21T07:57:01.209ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9d3dfbc3-3d3a-4f09-acb0-912b1c7d9cc9", "date": "Sat, 21 Dec 2024 07:57:01 GMT"} })
120622024-12-21T07:57:01.209ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
120632024-12-21T07:57:01.209ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
120642024-12-21T07:57:01.210ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7f3a330-5837-4784-bdb3-bb64544795ac", "content-length": "682", "date": "Sat, 21 Dec 2024 07:57:01 GMT"} })
120652024-12-21T07:57:01.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120662024-12-21T07:57:01.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120672024-12-21T07:57:01.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120682024-12-21T07:57:01.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120692024-12-21T07:57:01.217ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120702024-12-21T07:57:01.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120712024-12-21T07:57:01.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120722024-12-21T07:57:01.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120732024-12-21T07:57:01.228ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 560.628677ms iteration = 29 status = {}
120742024-12-21T07:57:01.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a4710107-70f5-452b-a19a-5c809523511f roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120752024-12-21T07:57:01.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a4710107-70f5-452b-a19a-5c809523511f resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120762024-12-21T07:57:01.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a4710107-70f5-452b-a19a-5c809523511f response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120772024-12-21T07:57:02.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d978bdef-b11a-49ba-9654-fb25f653da61 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120782024-12-21T07:57:02.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d978bdef-b11a-49ba-9654-fb25f653da61 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120792024-12-21T07:57:02.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d978bdef-b11a-49ba-9654-fb25f653da61 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120802024-12-21T07:57:03.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bfeea125-c496-47db-be28-dd47711e8d4e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120812024-12-21T07:57:03.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bfeea125-c496-47db-be28-dd47711e8d4e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120822024-12-21T07:57:03.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bfeea125-c496-47db-be28-dd47711e8d4e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120832024-12-21T07:57:04.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4017b9cb-87b5-4f5d-b194-c0c7a490dd66 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120842024-12-21T07:57:04.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4017b9cb-87b5-4f5d-b194-c0c7a490dd66 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120852024-12-21T07:57:04.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4017b9cb-87b5-4f5d-b194-c0c7a490dd66 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120862024-12-21T07:57:04.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = b46510b1-3ef5-4f82-b3da-c9b3d9bc0ed6 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
120872024-12-21T07:57:04.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = b46510b1-3ef5-4f82-b3da-c9b3d9bc0ed6 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
120882024-12-21T07:57:04.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = b46510b1-3ef5-4f82-b3da-c9b3d9bc0ed6 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
120892024-12-21T07:57:04.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = cbbe9e69-e702-44c5-a792-deb6413467d9 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
120902024-12-21T07:57:04.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = cbbe9e69-e702-44c5-a792-deb6413467d9 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
120912024-12-21T07:57:04.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = cbbe9e69-e702-44c5-a792-deb6413467d9 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
120922024-12-21T07:57:05.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f467aad3-0e28-4d5d-8854-dd3b8111f77a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120932024-12-21T07:57:05.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f467aad3-0e28-4d5d-8854-dd3b8111f77a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120942024-12-21T07:57:05.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f467aad3-0e28-4d5d-8854-dd3b8111f77a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120952024-12-21T07:57:06.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 91dab796-3a6a-4aca-884a-b61d070cdfb4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120962024-12-21T07:57:06.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 91dab796-3a6a-4aca-884a-b61d070cdfb4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120972024-12-21T07:57:06.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2736 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 91dab796-3a6a-4aca-884a-b61d070cdfb4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120982024-12-21T07:57:07.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 24e09931-4d57-4e2f-8b95-5bf0caad5150 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
120992024-12-21T07:57:07.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 24e09931-4d57-4e2f-8b95-5bf0caad5150 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121002024-12-21T07:57:07.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2741 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 24e09931-4d57-4e2f-8b95-5bf0caad5150 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121012024-12-21T07:57:08.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bc150f3d-2f96-4993-9156-68489ca040f8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121022024-12-21T07:57:08.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bc150f3d-2f96-4993-9156-68489ca040f8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121032024-12-21T07:57:08.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2832 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bc150f3d-2f96-4993-9156-68489ca040f8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121042024-12-21T07:57:09.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dabaa796-3a87-4d9b-bfe7-f827f54618b4 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121052024-12-21T07:57:09.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dabaa796-3a87-4d9b-bfe7-f827f54618b4 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121062024-12-21T07:57:09.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = dabaa796-3a87-4d9b-bfe7-f827f54618b4 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121072024-12-21T07:57:09.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1524 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 27ca27f8-53a2-437d-a20c-8a31b9cd427c response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
121082024-12-21T07:57:10.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 701b37ae-628b-48db-ac30-38171b04db9d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121092024-12-21T07:57:10.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 701b37ae-628b-48db-ac30-38171b04db9d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121102024-12-21T07:57:10.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 701b37ae-628b-48db-ac30-38171b04db9d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121112024-12-21T07:57:10.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
121122024-12-21T07:57:10.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
121132024-12-21T07:57:10.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121142024-12-21T07:57:10.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121152024-12-21T07:57:10.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121162024-12-21T07:57:10.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121172024-12-21T07:57:10.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121182024-12-21T07:57:10.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
121192024-12-21T07:57:10.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121202024-12-21T07:57:10.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121212024-12-21T07:57:10.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121222024-12-21T07:57:10.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121232024-12-21T07:57:10.703ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121242024-12-21T07:57:10.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121252024-12-21T07:57:10.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121262024-12-21T07:57:10.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.648033ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
121272024-12-21T07:57:10.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
121282024-12-21T07:57:10.707ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121292024-12-21T07:57:10.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121302024-12-21T07:57:10.720ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
121312024-12-21T07:57:10.720ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.310988ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
121322024-12-21T07:57:11.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8a271e60-f505-4226-b654-216865f134ca roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121332024-12-21T07:57:11.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8a271e60-f505-4226-b654-216865f134ca resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121342024-12-21T07:57:11.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8a271e60-f505-4226-b654-216865f134ca response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121352024-12-21T07:57:12.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 05daa475-b2b8-4765-b73e-daa07212efda roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121362024-12-21T07:57:12.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 05daa475-b2b8-4765-b73e-daa07212efda resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121372024-12-21T07:57:12.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 05daa475-b2b8-4765-b73e-daa07212efda response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121382024-12-21T07:57:13.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c41742ab-1255-44ea-a374-e79c63a23933 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121392024-12-21T07:57:13.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c41742ab-1255-44ea-a374-e79c63a23933 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121402024-12-21T07:57:13.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c41742ab-1255-44ea-a374-e79c63a23933 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121412024-12-21T07:57:14.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6aabefb0-17e9-466c-b4d8-61ebf0f4e013 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121422024-12-21T07:57:14.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6aabefb0-17e9-466c-b4d8-61ebf0f4e013 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121432024-12-21T07:57:14.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6aabefb0-17e9-466c-b4d8-61ebf0f4e013 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121442024-12-21T07:57:15.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3325ce8f-c2d3-4d6e-a7da-76651ee594c0 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121452024-12-21T07:57:15.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3325ce8f-c2d3-4d6e-a7da-76651ee594c0 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121462024-12-21T07:57:15.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 3325ce8f-c2d3-4d6e-a7da-76651ee594c0 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121472024-12-21T07:57:16.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 6e28503e-5474-437e-82d0-e53a158f0f70 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
121482024-12-21T07:57:16.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 6e28503e-5474-437e-82d0-e53a158f0f70 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
121492024-12-21T07:57:16.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 6e28503e-5474-437e-82d0-e53a158f0f70 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
121502024-12-21T07:57:16.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 381dc0eb-2974-4125-8415-c50d3e39f517 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121512024-12-21T07:57:16.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 381dc0eb-2974-4125-8415-c50d3e39f517 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121522024-12-21T07:57:16.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 381dc0eb-2974-4125-8415-c50d3e39f517 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121532024-12-21T07:57:17.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 17632574-e073-4a49-ab4a-a1a149cfcc31 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121542024-12-21T07:57:17.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 17632574-e073-4a49-ab4a-a1a149cfcc31 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121552024-12-21T07:57:17.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 17632574-e073-4a49-ab4a-a1a149cfcc31 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121562024-12-21T07:57:18.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6ee636c1-2c96-4528-9cab-303d6d7f69e0 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121572024-12-21T07:57:18.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6ee636c1-2c96-4528-9cab-303d6d7f69e0 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121582024-12-21T07:57:18.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6ee636c1-2c96-4528-9cab-303d6d7f69e0 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121592024-12-21T07:57:19.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f65e3a4e-4ebd-40cd-8c75-78f088892db2 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121602024-12-21T07:57:19.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f65e3a4e-4ebd-40cd-8c75-78f088892db2 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121612024-12-21T07:57:19.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f65e3a4e-4ebd-40cd-8c75-78f088892db2 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121622024-12-21T07:57:19.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 1550c420-bc08-4173-aac8-f02a3d0f2638 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
121632024-12-21T07:57:19.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 1550c420-bc08-4173-aac8-f02a3d0f2638 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
121642024-12-21T07:57:19.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 1550c420-bc08-4173-aac8-f02a3d0f2638 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
121652024-12-21T07:57:19.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 42e57201-3b8e-4b83-bdd3-d19c4746d92d roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
121662024-12-21T07:57:19.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 42e57201-3b8e-4b83-bdd3-d19c4746d92d resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
121672024-12-21T07:57:19.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 42e57201-3b8e-4b83-bdd3-d19c4746d92d response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
121682024-12-21T07:57:19.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1323 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 9b9ff9dd-9ac4-42ca-a60a-adad1cf75582 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
121692024-12-21T07:57:20.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
121702024-12-21T07:57:20.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
121712024-12-21T07:57:20.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121722024-12-21T07:57:20.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121732024-12-21T07:57:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121742024-12-21T07:57:20.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121752024-12-21T07:57:20.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121762024-12-21T07:57:20.670ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121772024-12-21T07:57:20.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121782024-12-21T07:57:20.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.228817ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
121792024-12-21T07:57:20.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
121802024-12-21T07:57:20.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121812024-12-21T07:57:20.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121822024-12-21T07:57:20.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121832024-12-21T07:57:20.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121842024-12-21T07:57:20.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121852024-12-21T07:57:20.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
121862024-12-21T07:57:20.679ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121872024-12-21T07:57:20.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121882024-12-21T07:57:20.691ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
121892024-12-21T07:57:20.691ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.106861ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
121902024-12-21T07:57:20.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bdc652a5-a055-4edb-8a1f-4fde93e149cd roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121912024-12-21T07:57:20.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bdc652a5-a055-4edb-8a1f-4fde93e149cd resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121922024-12-21T07:57:20.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = bdc652a5-a055-4edb-8a1f-4fde93e149cd response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121932024-12-21T07:57:21.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7731edad-80a1-4b51-b24d-51d6a4a54fcb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121942024-12-21T07:57:21.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7731edad-80a1-4b51-b24d-51d6a4a54fcb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121952024-12-21T07:57:21.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 7731edad-80a1-4b51-b24d-51d6a4a54fcb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121962024-12-21T07:57:22.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 11c0117d-ae96-4b41-93f4-4bad1f9fa55e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121972024-12-21T07:57:22.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 11c0117d-ae96-4b41-93f4-4bad1f9fa55e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121982024-12-21T07:57:22.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 11c0117d-ae96-4b41-93f4-4bad1f9fa55e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
121992024-12-21T07:57:23.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f725a48f-53cd-49a6-9260-1e5d4bf7c501 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122002024-12-21T07:57:23.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f725a48f-53cd-49a6-9260-1e5d4bf7c501 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122012024-12-21T07:57:23.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2659 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = f725a48f-53cd-49a6-9260-1e5d4bf7c501 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122022024-12-21T07:57:24.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2acb57ec-45cc-4078-9fcb-2121d9c89a48 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122032024-12-21T07:57:24.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2acb57ec-45cc-4078-9fcb-2121d9c89a48 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122042024-12-21T07:57:24.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2674 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 2acb57ec-45cc-4078-9fcb-2121d9c89a48 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122052024-12-21T07:57:25.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4d36eb6b-de96-4ab8-a223-0781a99e26ae roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122062024-12-21T07:57:25.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4d36eb6b-de96-4ab8-a223-0781a99e26ae resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122072024-12-21T07:57:25.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4d36eb6b-de96-4ab8-a223-0781a99e26ae response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122082024-12-21T07:57:26.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ea4288e8-a3c1-486c-a869-187554d5d4fa roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122092024-12-21T07:57:26.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ea4288e8-a3c1-486c-a869-187554d5d4fa resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122102024-12-21T07:57:26.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ea4288e8-a3c1-486c-a869-187554d5d4fa response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122112024-12-21T07:57:27.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d7ec05de-bd9b-4c5c-a3c0-790f582c2b34 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122122024-12-21T07:57:27.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d7ec05de-bd9b-4c5c-a3c0-790f582c2b34 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122132024-12-21T07:57:27.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d7ec05de-bd9b-4c5c-a3c0-790f582c2b34 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122142024-12-21T07:57:28.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cc04e3e5-2120-4321-90da-9667b02d4b1c roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122152024-12-21T07:57:28.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cc04e3e5-2120-4321-90da-9667b02d4b1c resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122162024-12-21T07:57:28.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = cc04e3e5-2120-4321-90da-9667b02d4b1c response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122172024-12-21T07:57:29.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1636 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 25b511d5-073f-46f4-b9e6-0f17642fd7fc response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
122182024-12-21T07:57:29.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 09a6979b-07d6-4cec-9e0d-e086ac84e1b5 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122192024-12-21T07:57:29.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 09a6979b-07d6-4cec-9e0d-e086ac84e1b5 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122202024-12-21T07:57:29.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 09a6979b-07d6-4cec-9e0d-e086ac84e1b5 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
122212024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
122222024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
122232024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
122242024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
122252024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122262024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
122272024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
122282024-12-21T07:57:30.667ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
122292024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
122302024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122312024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122322024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
122332024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
122342024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
122352024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
122362024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
122372024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
122382024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
122392024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122402024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
122412024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
122422024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122432024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
122442024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
122452024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
122462024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
122472024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
122482024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
122492024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
122502024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122512024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122522024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
122532024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
122542024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
122552024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122562024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
122572024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
122582024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122592024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
122602024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122612024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122622024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122632024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
122642024-12-21T07:57:30.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
122652024-12-21T07:57:30.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
122662024-12-21T07:57:30.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
122672024-12-21T07:57:30.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122682024-12-21T07:57:30.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122692024-12-21T07:57:30.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
122702024-12-21T07:57:30.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122712024-12-21T07:57:30.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122722024-12-21T07:57:30.670ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122732024-12-21T07:57:30.670ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122742024-12-21T07:57:30.671ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.155009ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
122752024-12-21T07:57:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
122762024-12-21T07:57:30.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122772024-12-21T07:57:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
122782024-12-21T07:57:30.673ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
122792024-12-21T07:57:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122802024-12-21T07:57:30.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
122812024-12-21T07:57:30.676ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1784, tv_nsec: 374499351 } })
122822024-12-21T07:57:30.676ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
122832024-12-21T07:57:30.680ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122842024-12-21T07:57:30.682ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1784, tv_nsec: 380570132 } })
122852024-12-21T07:57:30.682ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
122862024-12-21T07:57:30.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
122872024-12-21T07:57:30.683ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122882024-12-21T07:57:30.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122892024-12-21T07:57:30.686ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1784, tv_nsec: 384691200 } })
122902024-12-21T07:57:30.686ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
122912024-12-21T07:57:30.692ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122922024-12-21T07:57:30.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122932024-12-21T07:57:30.707ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 40.181659ms iteration = 30 status = {"errors":[],"finish_invoked_ok":[]}
122942024-12-21T07:57:30.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122952024-12-21T07:57:30.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122962024-12-21T07:57:30.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122972024-12-21T07:57:30.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122982024-12-21T07:57:30.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122992024-12-21T07:57:30.714ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
123002024-12-21T07:57:30.714ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123012024-12-21T07:57:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123022024-12-21T07:57:30.715ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123032024-12-21T07:57:30.715ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123042024-12-21T07:57:30.715ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
123052024-12-21T07:57:30.715ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123062024-12-21T07:57:30.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123072024-12-21T07:57:30.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123082024-12-21T07:57:30.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123092024-12-21T07:57:30.716ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123102024-12-21T07:57:30.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123112024-12-21T07:57:30.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
123122024-12-21T07:57:30.717ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123132024-12-21T07:57:30.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123142024-12-21T07:57:30.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123152024-12-21T07:57:30.717ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123162024-12-21T07:57:30.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123172024-12-21T07:57:30.718ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
123182024-12-21T07:57:30.718ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123192024-12-21T07:57:30.718ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
123202024-12-21T07:57:30.718ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123212024-12-21T07:57:30.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
123222024-12-21T07:57:30.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123232024-12-21T07:57:30.718ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123242024-12-21T07:57:30.718ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
123252024-12-21T07:57:30.719ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123262024-12-21T07:57:30.719ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.789562ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123272024-12-21T07:57:30.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123282024-12-21T07:57:30.721ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123292024-12-21T07:57:30.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
123302024-12-21T07:57:30.721ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123312024-12-21T07:57:30.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123322024-12-21T07:57:30.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123332024-12-21T07:57:30.723ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
123342024-12-21T07:57:30.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
123352024-12-21T07:57:30.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123362024-12-21T07:57:30.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123372024-12-21T07:57:30.724ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.738465ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
123382024-12-21T07:57:30.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123392024-12-21T07:57:30.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
123402024-12-21T07:57:30.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123412024-12-21T07:57:30.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123422024-12-21T07:57:30.727ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
123432024-12-21T07:57:30.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123442024-12-21T07:57:30.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
123452024-12-21T07:57:30.729ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
123462024-12-21T07:57:30.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
123472024-12-21T07:57:30.729ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
123482024-12-21T07:57:30.729ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.087673ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
123492024-12-21T07:57:30.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
123502024-12-21T07:57:30.729ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123512024-12-21T07:57:30.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123522024-12-21T07:57:30.734ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
123532024-12-21T07:57:30.734ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.391932ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
123542024-12-21T07:57:30.751ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123552024-12-21T07:57:30.751ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
123562024-12-21T07:57:30.751ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 83.869735ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
123572024-12-21T07:57:30.753ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 85.654365ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
123582024-12-21T07:57:30.764ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
123592024-12-21T07:57:30.764ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
123602024-12-21T07:57:30.764ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc8202b2-81ae-4358-8a16-034c115e4cc6", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:30 GMT"} })
123612024-12-21T07:57:30.764ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
123622024-12-21T07:57:30.766ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
123632024-12-21T07:57:30.783ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123642024-12-21T07:57:30.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123652024-12-21T07:57:30.792ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
123662024-12-21T07:57:30.792ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
123672024-12-21T07:57:30.792ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6c3ed3e-1c37-404a-b851-c0eafa4252b5", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:30 GMT"} })
123682024-12-21T07:57:30.792ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
123692024-12-21T07:57:30.792ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
123702024-12-21T07:57:30.792ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
123712024-12-21T07:57:30.793ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "64723a03-b8dc-4322-84a5-aadc2ede613a", "content-length": "26", "date": "Sat, 21 Dec 2024 07:57:30 GMT"} })
123722024-12-21T07:57:30.793ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
123732024-12-21T07:57:30.794ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
123742024-12-21T07:57:30.795ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
123752024-12-21T07:57:30.839ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
123762024-12-21T07:57:30.839ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
123772024-12-21T07:57:30.840ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cfbd022-3764-474b-b7ec-613b316236c3", "content-length": "372", "date": "Sat, 21 Dec 2024 07:57:29 GMT"} })
123782024-12-21T07:57:30.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123792024-12-21T07:57:30.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123802024-12-21T07:57:30.844ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 176.504637ms iteration = 30 status = 0
123812024-12-21T07:57:30.875ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
123822024-12-21T07:57:30.875ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2375243-156a-4f8f-826e-4e1e71af2946", "content-length": "2", "date": "Sat, 21 Dec 2024 07:57:30 GMT"} })
123832024-12-21T07:57:30.878ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
123842024-12-21T07:57:30.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
123852024-12-21T07:57:30.881ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 213.805068ms iteration = 30 status = null
123862024-12-21T07:57:30.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 215.11551ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
123872024-12-21T07:57:30.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 219.074725ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
123882024-12-21T07:57:30.887ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 220.127382ms iteration = 34 status = {"physical_disks_added":0}
123892024-12-21T07:57:30.888ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 221.390914ms iteration = 30 status = {}
123902024-12-21T07:57:30.891ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
123912024-12-21T07:57:30.891ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
123922024-12-21T07:57:30.891ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "193da53f-2763-4039-ae36-56ae6c88a608", "date": "Sat, 21 Dec 2024 07:57:30 GMT"} })
123932024-12-21T07:57:30.891ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123942024-12-21T07:57:30.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123952024-12-21T07:57:30.894ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123962024-12-21T07:57:30.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123972024-12-21T07:57:30.897ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123982024-12-21T07:57:30.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123992024-12-21T07:57:30.900ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
124002024-12-21T07:57:30.900ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124012024-12-21T07:57:30.901ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "63222865-a752-400c-8ae5-7583df7054fa", "date": "Sat, 21 Dec 2024 07:57:30 GMT"} })
124022024-12-21T07:57:30.902ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 235.61536ms iteration = 32 status = {}
124032024-12-21T07:57:30.947ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124042024-12-21T07:57:30.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124052024-12-21T07:57:30.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c763d9e3-bc34-4e6c-b1b8-d94b8bc0876d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124062024-12-21T07:57:30.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c763d9e3-bc34-4e6c-b1b8-d94b8bc0876d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124072024-12-21T07:57:30.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c763d9e3-bc34-4e6c-b1b8-d94b8bc0876d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124082024-12-21T07:57:30.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124092024-12-21T07:57:30.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124102024-12-21T07:57:30.966ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
124112024-12-21T07:57:30.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124122024-12-21T07:57:30.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124132024-12-21T07:57:30.976ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
124142024-12-21T07:57:30.976ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a21d874d-4896-48f5-8a36-65a08c28288f", "content-length": "134", "date": "Sat, 21 Dec 2024 07:57:30 GMT"} })
124152024-12-21T07:57:30.976ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
124162024-12-21T07:57:30.976ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
124172024-12-21T07:57:30.977ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
124182024-12-21T07:57:30.977ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
124192024-12-21T07:57:30.977ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124202024-12-21T07:57:30.977ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124212024-12-21T07:57:30.977ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124222024-12-21T07:57:30.977ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
124232024-12-21T07:57:30.977ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124242024-12-21T07:57:30.977ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
124252024-12-21T07:57:30.977ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
124262024-12-21T07:57:30.977ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124272024-12-21T07:57:30.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124282024-12-21T07:57:30.980ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
124292024-12-21T07:57:30.980ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "07b66863-93f5-4d08-b783-fc846084eec7", "content-length": "2", "date": "Sat, 21 Dec 2024 07:57:30 GMT"} })
124302024-12-21T07:57:30.980ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
124312024-12-21T07:57:30.980ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "58cc3607-3c4e-41a1-8a9a-0921badf425e", "content-length": "52", "date": "Sat, 21 Dec 2024 07:57:30 GMT"} })
124322024-12-21T07:57:30.980ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
124332024-12-21T07:57:30.980ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
124342024-12-21T07:57:30.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124352024-12-21T07:57:30.988ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
124362024-12-21T07:57:30.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124372024-12-21T07:57:30.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124382024-12-21T07:57:31.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124392024-12-21T07:57:31.020ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
124402024-12-21T07:57:31.020ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124412024-12-21T07:57:31.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124422024-12-21T07:57:31.054ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
124432024-12-21T07:57:31.082ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "25074c73-b552-47e1-b806-3c21daa2dcf0", "date": "Sat, 21 Dec 2024 07:57:30 GMT"} })
124442024-12-21T07:57:31.082ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
124452024-12-21T07:57:31.082ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
124462024-12-21T07:57:31.082ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "108092ca-c4cc-4c97-bcf2-e248e575af5a", "content-length": "691", "date": "Sat, 21 Dec 2024 07:57:30 GMT"} })
124472024-12-21T07:57:31.083ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
124482024-12-21T07:57:31.083ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
124492024-12-21T07:57:31.083ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
124502024-12-21T07:57:31.083ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c963acc-4be7-404d-b537-f28aac88fbcb", "content-length": "682", "date": "Sat, 21 Dec 2024 07:57:31 GMT"} })
124512024-12-21T07:57:31.083ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124522024-12-21T07:57:31.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124532024-12-21T07:57:31.085ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 417.962873ms iteration = 31 status = {}
124542024-12-21T07:57:31.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124552024-12-21T07:57:31.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124562024-12-21T07:57:31.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124572024-12-21T07:57:31.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124582024-12-21T07:57:31.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124592024-12-21T07:57:31.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124602024-12-21T07:57:31.098ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 431.610201ms iteration = 30 status = {}
124612024-12-21T07:57:31.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4ced52d3-2951-43a3-b18a-3c68fa658a3e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124622024-12-21T07:57:31.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4ced52d3-2951-43a3-b18a-3c68fa658a3e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124632024-12-21T07:57:31.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4ced52d3-2951-43a3-b18a-3c68fa658a3e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124642024-12-21T07:57:33.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b5219fbc-2d93-4d86-9d09-08cc858f1ea2 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124652024-12-21T07:57:33.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b5219fbc-2d93-4d86-9d09-08cc858f1ea2 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124662024-12-21T07:57:33.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2784 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b5219fbc-2d93-4d86-9d09-08cc858f1ea2 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124672024-12-21T07:57:34.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d734df83-62e4-46c0-a052-b6032a74a1ec roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124682024-12-21T07:57:34.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d734df83-62e4-46c0-a052-b6032a74a1ec resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124692024-12-21T07:57:34.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2611 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d734df83-62e4-46c0-a052-b6032a74a1ec response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124702024-12-21T07:57:34.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 251a6799-d46e-4dff-8817-e69317846a1c roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
124712024-12-21T07:57:34.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 251a6799-d46e-4dff-8817-e69317846a1c resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
124722024-12-21T07:57:34.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3054 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 251a6799-d46e-4dff-8817-e69317846a1c response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
124732024-12-21T07:57:34.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = dd8563a2-85a4-4d17-8d0c-049e22a1db9a roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
124742024-12-21T07:57:34.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = dd8563a2-85a4-4d17-8d0c-049e22a1db9a resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
124752024-12-21T07:57:34.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = dd8563a2-85a4-4d17-8d0c-049e22a1db9a response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
124762024-12-21T07:57:35.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 19360e17-76a8-4531-b439-7383c9bb7709 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124772024-12-21T07:57:35.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 19360e17-76a8-4531-b439-7383c9bb7709 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124782024-12-21T07:57:35.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 19360e17-76a8-4531-b439-7383c9bb7709 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124792024-12-21T07:57:36.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d0fce9e2-d3b0-41ed-aa4d-674f8b817ed9 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124802024-12-21T07:57:36.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d0fce9e2-d3b0-41ed-aa4d-674f8b817ed9 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124812024-12-21T07:57:36.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d0fce9e2-d3b0-41ed-aa4d-674f8b817ed9 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124822024-12-21T07:57:37.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ee7f7948-ff4e-44f2-badb-c9b98c5e11ff roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124832024-12-21T07:57:37.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ee7f7948-ff4e-44f2-badb-c9b98c5e11ff resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124842024-12-21T07:57:37.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = ee7f7948-ff4e-44f2-badb-c9b98c5e11ff response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124852024-12-21T07:57:38.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 179e5b94-3095-40d9-84d6-c09d901aac86 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124862024-12-21T07:57:38.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 179e5b94-3095-40d9-84d6-c09d901aac86 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124872024-12-21T07:57:38.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 179e5b94-3095-40d9-84d6-c09d901aac86 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124882024-12-21T07:57:39.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4b51a0b5-f353-47e9-8655-b631d6dadf47 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124892024-12-21T07:57:39.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4b51a0b5-f353-47e9-8655-b631d6dadf47 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124902024-12-21T07:57:39.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4b51a0b5-f353-47e9-8655-b631d6dadf47 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124912024-12-21T07:57:39.745ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1900 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = a3766ec6-15a7-46be-857f-3577da454d6a response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
124922024-12-21T07:57:40.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 848bbe98-7d1e-47b1-bbc7-48218c8796d3 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124932024-12-21T07:57:40.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 848bbe98-7d1e-47b1-bbc7-48218c8796d3 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124942024-12-21T07:57:40.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 848bbe98-7d1e-47b1-bbc7-48218c8796d3 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
124952024-12-21T07:57:40.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
124962024-12-21T07:57:40.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
124972024-12-21T07:57:40.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124982024-12-21T07:57:40.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124992024-12-21T07:57:40.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125002024-12-21T07:57:40.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125012024-12-21T07:57:40.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125022024-12-21T07:57:40.697ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125032024-12-21T07:57:40.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125042024-12-21T07:57:40.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
125052024-12-21T07:57:40.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125062024-12-21T07:57:40.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125072024-12-21T07:57:40.701ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125082024-12-21T07:57:40.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125092024-12-21T07:57:40.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.156035ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125102024-12-21T07:57:40.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125112024-12-21T07:57:40.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
125122024-12-21T07:57:40.730ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125132024-12-21T07:57:40.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125142024-12-21T07:57:40.742ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
125152024-12-21T07:57:40.742ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.50142ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
125162024-12-21T07:57:41.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 48f377be-ecb0-4f6f-b074-d7d21c5323cc roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125172024-12-21T07:57:41.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 48f377be-ecb0-4f6f-b074-d7d21c5323cc resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125182024-12-21T07:57:41.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 48f377be-ecb0-4f6f-b074-d7d21c5323cc response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125192024-12-21T07:57:42.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 36c45373-1888-40d7-9d47-3c4698950315 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125202024-12-21T07:57:42.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 36c45373-1888-40d7-9d47-3c4698950315 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125212024-12-21T07:57:42.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 36c45373-1888-40d7-9d47-3c4698950315 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125222024-12-21T07:57:43.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a22e2e5f-f1e6-40a9-966d-119c57eff4cc roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125232024-12-21T07:57:43.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a22e2e5f-f1e6-40a9-966d-119c57eff4cc resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125242024-12-21T07:57:43.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a22e2e5f-f1e6-40a9-966d-119c57eff4cc response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125252024-12-21T07:57:44.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 08ea4490-d39d-4a55-aee4-65edab479273 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125262024-12-21T07:57:44.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 08ea4490-d39d-4a55-aee4-65edab479273 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125272024-12-21T07:57:44.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 08ea4490-d39d-4a55-aee4-65edab479273 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125282024-12-21T07:57:45.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e4e60b75-29f6-421c-95c0-ee034218d5b0 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125292024-12-21T07:57:45.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e4e60b75-29f6-421c-95c0-ee034218d5b0 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125302024-12-21T07:57:45.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = e4e60b75-29f6-421c-95c0-ee034218d5b0 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125312024-12-21T07:57:46.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8919892c-e556-4402-a9bc-53697ff43bcf roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125322024-12-21T07:57:46.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8919892c-e556-4402-a9bc-53697ff43bcf resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125332024-12-21T07:57:46.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 8919892c-e556-4402-a9bc-53697ff43bcf response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125342024-12-21T07:57:46.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 136e21cd-e46e-4fa5-814e-a016a65da9cd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
125352024-12-21T07:57:46.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 136e21cd-e46e-4fa5-814e-a016a65da9cd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
125362024-12-21T07:57:46.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:48551 req_id = 136e21cd-e46e-4fa5-814e-a016a65da9cd response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
125372024-12-21T07:57:47.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4787786a-0a79-4a1a-93fa-48808b390b0d roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125382024-12-21T07:57:47.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4787786a-0a79-4a1a-93fa-48808b390b0d resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125392024-12-21T07:57:47.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 4787786a-0a79-4a1a-93fa-48808b390b0d response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125402024-12-21T07:57:48.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9400130d-30e6-44d8-8945-c5fac713aa6a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125412024-12-21T07:57:48.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9400130d-30e6-44d8-8945-c5fac713aa6a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125422024-12-21T07:57:48.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 9400130d-30e6-44d8-8945-c5fac713aa6a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125432024-12-21T07:57:49.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d4094225-c7db-4c18-a249-5c1d790310b1 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125442024-12-21T07:57:49.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d4094225-c7db-4c18-a249-5c1d790310b1 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125452024-12-21T07:57:49.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d4094225-c7db-4c18-a249-5c1d790310b1 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125462024-12-21T07:57:49.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 51d050ca-137c-4141-8e21-50f921ec6fdd roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
125472024-12-21T07:57:49.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 51d050ca-137c-4141-8e21-50f921ec6fdd resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
125482024-12-21T07:57:49.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2512 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 51d050ca-137c-4141-8e21-50f921ec6fdd response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
125492024-12-21T07:57:49.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 0fad9c76-e3f7-435c-833d-68793a06fe21 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
125502024-12-21T07:57:49.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 0fad9c76-e3f7-435c-833d-68793a06fe21 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
125512024-12-21T07:57:49.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 0fad9c76-e3f7-435c-833d-68793a06fe21 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
125522024-12-21T07:57:49.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1568 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 49ab56a7-c2c0-4632-b122-616b7c39f670 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
125532024-12-21T07:57:50.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d3dbbd72-4bd7-424e-9882-75253dfcd265 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125542024-12-21T07:57:50.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d3dbbd72-4bd7-424e-9882-75253dfcd265 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125552024-12-21T07:57:50.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2674 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d3dbbd72-4bd7-424e-9882-75253dfcd265 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125562024-12-21T07:57:50.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
125572024-12-21T07:57:50.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
125582024-12-21T07:57:50.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125592024-12-21T07:57:50.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125602024-12-21T07:57:50.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125612024-12-21T07:57:50.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125622024-12-21T07:57:50.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125632024-12-21T07:57:50.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
125642024-12-21T07:57:50.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125652024-12-21T07:57:50.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125662024-12-21T07:57:50.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125672024-12-21T07:57:50.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125682024-12-21T07:57:50.701ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125692024-12-21T07:57:50.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125702024-12-21T07:57:50.710ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125712024-12-21T07:57:50.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
125722024-12-21T07:57:50.712ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125732024-12-21T07:57:50.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125742024-12-21T07:57:50.724ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
125752024-12-21T07:57:50.724ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.587162ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
125762024-12-21T07:57:50.738ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.942841ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125772024-12-21T07:57:51.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 89663aa1-3866-462d-9154-604fa76728bb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125782024-12-21T07:57:51.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 89663aa1-3866-462d-9154-604fa76728bb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125792024-12-21T07:57:51.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 89663aa1-3866-462d-9154-604fa76728bb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125802024-12-21T07:57:52.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c7adbbad-ec27-4c7f-a0f4-292372bf9a86 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125812024-12-21T07:57:52.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c7adbbad-ec27-4c7f-a0f4-292372bf9a86 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125822024-12-21T07:57:52.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = c7adbbad-ec27-4c7f-a0f4-292372bf9a86 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125832024-12-21T07:57:53.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 05e70da7-fa20-46fb-8e95-e086bc8620c8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125842024-12-21T07:57:53.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 05e70da7-fa20-46fb-8e95-e086bc8620c8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125852024-12-21T07:57:53.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 05e70da7-fa20-46fb-8e95-e086bc8620c8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125862024-12-21T07:57:54.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 87595930-9425-494d-9af5-c0637ec8c649 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125872024-12-21T07:57:54.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 87595930-9425-494d-9af5-c0637ec8c649 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125882024-12-21T07:57:54.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 87595930-9425-494d-9af5-c0637ec8c649 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125892024-12-21T07:57:55.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6e9a5b9c-72d4-4b71-8170-2c02b474d0c8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125902024-12-21T07:57:55.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6e9a5b9c-72d4-4b71-8170-2c02b474d0c8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125912024-12-21T07:57:55.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 6e9a5b9c-72d4-4b71-8170-2c02b474d0c8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125922024-12-21T07:57:56.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 50af6fe3-9b8a-4c19-b398-33de4a1f55a6 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125932024-12-21T07:57:56.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 50af6fe3-9b8a-4c19-b398-33de4a1f55a6 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125942024-12-21T07:57:56.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 50af6fe3-9b8a-4c19-b398-33de4a1f55a6 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125952024-12-21T07:57:57.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 75d80025-5e93-42f8-958f-45a9e452fb1e roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125962024-12-21T07:57:57.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 75d80025-5e93-42f8-958f-45a9e452fb1e resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125972024-12-21T07:57:57.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 75d80025-5e93-42f8-958f-45a9e452fb1e response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125982024-12-21T07:57:58.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1f76d4b6-1fce-4e9a-9dfc-cbeef184f3f2 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
125992024-12-21T07:57:58.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1f76d4b6-1fce-4e9a-9dfc-cbeef184f3f2 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
126002024-12-21T07:57:58.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 1f76d4b6-1fce-4e9a-9dfc-cbeef184f3f2 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
126012024-12-21T07:57:59.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 625d8f9d-af4e-4047-9550-bec70401e185 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
126022024-12-21T07:57:59.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 625d8f9d-af4e-4047-9550-bec70401e185 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
126032024-12-21T07:57:59.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 625d8f9d-af4e-4047-9550-bec70401e185 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
126042024-12-21T07:57:59.745ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1682 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 22604dd0-6ef3-4d1b-844e-1148f917db77 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
126052024-12-21T07:58:00.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b6ca50a9-3c6f-40a1-a962-e1c33b752395 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
126062024-12-21T07:58:00.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b6ca50a9-3c6f-40a1-a962-e1c33b752395 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
126072024-12-21T07:58:00.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b6ca50a9-3c6f-40a1-a962-e1c33b752395 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
126082024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
126092024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
126102024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
126112024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 33 reason = Timeout
126122024-12-21T07:58:00.667ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
126132024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126142024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
126152024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 17 reason = Timeout
126162024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
126172024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
126182024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126192024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
126202024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
126212024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
126222024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
126232024-12-21T07:58:00.667ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b
126242024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
126252024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.67\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b"}
126262024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
126272024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126282024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 17 reason = Timeout
126292024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
126302024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
126312024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
126322024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
126332024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
126342024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
126352024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
126362024-12-21T07:58:00.667ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
126372024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 35 reason = Timeout
126382024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
126392024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
126402024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
126412024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
126422024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 17 reason = Timeout
126432024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
126442024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
126452024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
126462024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
126472024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
126482024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
126492024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
126502024-12-21T07:58:00.667ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 07:48:00.667623124 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
126512024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
126522024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 17 reason = Timeout
126532024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
126542024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
126552024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
126562024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
126572024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
126582024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
126592024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
126602024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
126612024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
126622024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
126632024-12-21T07:58:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
126642024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
126652024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 17 reason = Timeout
126662024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
126672024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
126682024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
126692024-12-21T07:58:00.668ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
126702024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126712024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
126722024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
126732024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126742024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
126752024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
126762024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126772024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
126782024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
126792024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126802024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
126812024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
126822024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126832024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
126842024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
126852024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
126862024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
126872024-12-21T07:58:00.668ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6bfae345-1659-4377-bca9-c55abec2aeb7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7c426166-4f75-4a87-b9ac-c0d590aea49b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea9fa927-131c-4a8f-87ef-b16050c734e7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1814, tv_nsec: 366713472 } })
126882024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
126892024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
126902024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
126912024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
126922024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
126932024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126942024-12-21T07:58:00.668ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4dd95bbd-e009-486c-8c96-451a6e195a49.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b2ae004a-4c01-4dcf-8e90-49ba61c66084.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1814, tv_nsec: 366782553 } })
126952024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
126962024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
126972024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
126982024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
126992024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
127002024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127012024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127022024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
127032024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127042024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
127052024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127062024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127072024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127082024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127092024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127102024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
127112024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.097839ms iteration = 17 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
127122024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
127132024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.597926ms iteration = 17 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
127142024-12-21T07:58:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127152024-12-21T07:58:00.670ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.824847ms iteration = 31 status = {"errors":[],"finish_invoked_ok":[]}
127162024-12-21T07:58:00.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127172024-12-21T07:58:00.671ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127182024-12-21T07:58:00.671ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.908925ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
127192024-12-21T07:58:00.672ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
127202024-12-21T07:58:00.672ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127212024-12-21T07:58:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127222024-12-21T07:58:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
127232024-12-21T07:58:00.673ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127242024-12-21T07:58:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127252024-12-21T07:58:00.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
127262024-12-21T07:58:00.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
127272024-12-21T07:58:00.675ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1814, tv_nsec: 374280958 } })
127282024-12-21T07:58:00.676ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
127292024-12-21T07:58:00.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
127302024-12-21T07:58:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
127312024-12-21T07:58:00.677ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
127322024-12-21T07:58:00.677ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
127332024-12-21T07:58:00.677ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
127342024-12-21T07:58:00.677ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 10.158919ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
127352024-12-21T07:58:00.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
127362024-12-21T07:58:00.682ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 07:48:00.667623124 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
127372024-12-21T07:58:00.682ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.564762ms iteration = 16 status = {"expiration":"2024-12-21T07:48:00.667623124Z","pruned":[]}
127382024-12-21T07:58:00.684ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.058624ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
127392024-12-21T07:58:00.685ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1814, tv_nsec: 383438670 } })
127402024-12-21T07:58:00.685ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
127412024-12-21T07:58:00.686ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127422024-12-21T07:58:00.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127432024-12-21T07:58:00.691ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127442024-12-21T07:58:00.693ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127452024-12-21T07:58:00.694ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
127462024-12-21T07:58:00.694ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
127472024-12-21T07:58:00.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
127482024-12-21T07:58:00.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
127492024-12-21T07:58:00.697ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127502024-12-21T07:58:00.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127512024-12-21T07:58:00.700ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127522024-12-21T07:58:00.703ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
127532024-12-21T07:58:00.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127542024-12-21T07:58:00.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127552024-12-21T07:58:00.705ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127562024-12-21T07:58:00.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127572024-12-21T07:58:00.710ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
127582024-12-21T07:58:00.710ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
127592024-12-21T07:58:00.712ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
127602024-12-21T07:58:00.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
127612024-12-21T07:58:00.713ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127622024-12-21T07:58:00.715ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
127632024-12-21T07:58:00.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
127642024-12-21T07:58:00.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
127652024-12-21T07:58:00.718ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127662024-12-21T07:58:00.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127672024-12-21T07:58:00.718ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
127682024-12-21T07:58:00.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
127692024-12-21T07:58:00.719ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127702024-12-21T07:58:00.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127712024-12-21T07:58:00.721ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127722024-12-21T07:58:00.721ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
127732024-12-21T07:58:00.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
127742024-12-21T07:58:00.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.616689ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
127752024-12-21T07:58:00.722ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127762024-12-21T07:58:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127772024-12-21T07:58:00.724ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127782024-12-21T07:58:00.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
127792024-12-21T07:58:00.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
127802024-12-21T07:58:00.726ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127812024-12-21T07:58:00.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
127822024-12-21T07:58:00.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127832024-12-21T07:58:00.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
127842024-12-21T07:58:00.727ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
127852024-12-21T07:58:00.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
127862024-12-21T07:58:00.728ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
127872024-12-21T07:58:00.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
127882024-12-21T07:58:00.729ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 62.100493ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
127892024-12-21T07:58:00.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127902024-12-21T07:58:00.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.727564ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
127912024-12-21T07:58:00.731ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
127922024-12-21T07:58:00.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
127932024-12-21T07:58:00.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
127942024-12-21T07:58:00.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127952024-12-21T07:58:00.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127962024-12-21T07:58:00.733ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127972024-12-21T07:58:00.734ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
127982024-12-21T07:58:00.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
127992024-12-21T07:58:00.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128002024-12-21T07:58:00.736ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1814, tv_nsec: 434387828 } })
128012024-12-21T07:58:00.736ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
128022024-12-21T07:58:00.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
128032024-12-21T07:58:00.736ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128042024-12-21T07:58:00.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128052024-12-21T07:58:00.736ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128062024-12-21T07:58:00.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128072024-12-21T07:58:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
128082024-12-21T07:58:00.739ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
128092024-12-21T07:58:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
128102024-12-21T07:58:00.740ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128112024-12-21T07:58:00.740ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
128122024-12-21T07:58:00.740ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
128132024-12-21T07:58:00.740ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
128142024-12-21T07:58:00.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
128152024-12-21T07:58:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128162024-12-21T07:58:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
128172024-12-21T07:58:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
128182024-12-21T07:58:00.740ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128192024-12-21T07:58:00.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128202024-12-21T07:58:00.741ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128212024-12-21T07:58:00.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
128222024-12-21T07:58:00.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128232024-12-21T07:58:00.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128242024-12-21T07:58:00.743ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
128252024-12-21T07:58:00.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
128262024-12-21T07:58:00.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
128272024-12-21T07:58:00.744ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128282024-12-21T07:58:00.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128292024-12-21T07:58:00.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128302024-12-21T07:58:00.746ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128312024-12-21T07:58:00.746ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
128322024-12-21T07:58:00.746ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
128332024-12-21T07:58:00.746ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
128342024-12-21T07:58:00.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
128352024-12-21T07:58:00.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128362024-12-21T07:58:00.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128372024-12-21T07:58:00.749ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128382024-12-21T07:58:00.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
128392024-12-21T07:58:00.749ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128402024-12-21T07:58:00.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128412024-12-21T07:58:00.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
128422024-12-21T07:58:00.750ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
128432024-12-21T07:58:00.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
128442024-12-21T07:58:00.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
128452024-12-21T07:58:00.751ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128462024-12-21T07:58:00.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128472024-12-21T07:58:00.753ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128482024-12-21T07:58:00.755ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 88.233598ms iteration = 7 status = {"nsuccess":5}
128492024-12-21T07:58:00.757ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128502024-12-21T07:58:00.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128512024-12-21T07:58:00.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
128522024-12-21T07:58:00.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128532024-12-21T07:58:00.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128542024-12-21T07:58:00.760ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128552024-12-21T07:58:00.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128562024-12-21T07:58:00.765ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128572024-12-21T07:58:00.765ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
128582024-12-21T07:58:00.765ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
128592024-12-21T07:58:00.765ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
128602024-12-21T07:58:00.765ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
128612024-12-21T07:58:00.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
128622024-12-21T07:58:00.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
128632024-12-21T07:58:00.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
128642024-12-21T07:58:00.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128652024-12-21T07:58:00.768ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128662024-12-21T07:58:00.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128672024-12-21T07:58:00.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
128682024-12-21T07:58:00.769ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128692024-12-21T07:58:00.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
128702024-12-21T07:58:00.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
128712024-12-21T07:58:00.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
128722024-12-21T07:58:00.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128732024-12-21T07:58:00.774ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128742024-12-21T07:58:00.775ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 108.152649ms iteration = 31 status = 0
128752024-12-21T07:58:00.776ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
128762024-12-21T07:58:00.776ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128772024-12-21T07:58:00.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128782024-12-21T07:58:00.778ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128792024-12-21T07:58:00.781ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128802024-12-21T07:58:00.782ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
128812024-12-21T07:58:00.783ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
128822024-12-21T07:58:00.783ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 115.672634ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
128832024-12-21T07:58:00.784ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
128842024-12-21T07:58:00.784ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
128852024-12-21T07:58:00.784ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 116.938686ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
128862024-12-21T07:58:00.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
128872024-12-21T07:58:00.784ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
128882024-12-21T07:58:00.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
128892024-12-21T07:58:00.785ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
128902024-12-21T07:58:00.785ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128912024-12-21T07:58:00.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128922024-12-21T07:58:00.785ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
128932024-12-21T07:58:00.786ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
128942024-12-21T07:58:00.786ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 118.853857ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
128952024-12-21T07:58:00.787ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
128962024-12-21T07:58:00.787ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
128972024-12-21T07:58:00.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
128982024-12-21T07:58:00.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
128992024-12-21T07:58:00.788ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129002024-12-21T07:58:00.789ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
129012024-12-21T07:58:00.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
129022024-12-21T07:58:00.790ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
129032024-12-21T07:58:00.790ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
129042024-12-21T07:58:00.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
129052024-12-21T07:58:00.799ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129062024-12-21T07:58:00.799ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
129072024-12-21T07:58:00.799ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
129082024-12-21T07:58:00.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
129092024-12-21T07:58:00.803ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
129102024-12-21T07:58:00.803ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
129112024-12-21T07:58:00.804ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec53e72f-87fa-440c-821a-ac8392692274", "content-length": "26", "date": "Sat, 21 Dec 2024 07:58:00 GMT"} })
129122024-12-21T07:58:00.804ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
129132024-12-21T07:58:00.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 137.371696ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
129142024-12-21T07:58:00.805ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
129152024-12-21T07:58:00.805ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 0 version = 2
129162024-12-21T07:58:00.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129172024-12-21T07:58:00.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129182024-12-21T07:58:00.806ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
129192024-12-21T07:58:00.806ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
129202024-12-21T07:58:00.806ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "37c3e0a5-456e-4067-b7b0-8f7861fab75d", "content-length": "26", "date": "Sat, 21 Dec 2024 07:58:00 GMT"} })
129212024-12-21T07:58:00.806ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
129222024-12-21T07:58:00.806ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
129232024-12-21T07:58:00.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129242024-12-21T07:58:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
129252024-12-21T07:58:00.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129262024-12-21T07:58:00.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129272024-12-21T07:58:00.810ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
129282024-12-21T07:58:00.810ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
129292024-12-21T07:58:00.810ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129302024-12-21T07:58:00.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129312024-12-21T07:58:00.810ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
129322024-12-21T07:58:00.842ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T07:42:50.264108Z, time_modified: 2024-12-21T07:42:50.264108Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, db_silo: Silo { identity: SiloIdentity { id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T07:43:40.996568Z, time_modified: 2024-12-21T07:43:40.996568Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767" }] }) }
129332024-12-21T07:58:00.842ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 174.781968ms iteration = 17 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]}},"default_endpoint":{"silo_id":"623f0f1c-4347-40f3-8cf7-f7d7c77efac3","tls_certs":["2533a854e4c099c5946e8c5f5b26fcd3f0cd4493b3310aec2c1db599161ed767"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
129342024-12-21T07:58:00.845ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129352024-12-21T07:58:00.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
129362024-12-21T07:58:00.850ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
129372024-12-21T07:58:00.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
129382024-12-21T07:58:00.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 183.728097ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
129392024-12-21T07:58:00.853ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129402024-12-21T07:58:00.853ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
129412024-12-21T07:58:00.853ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 185.544797ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
129422024-12-21T07:58:00.914ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 246.758005ms iteration = 35 status = {"physical_disks_added":0}
129432024-12-21T07:58:00.939ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
129442024-12-21T07:58:00.939ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 272.207029ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
129452024-12-21T07:58:00.952ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
129462024-12-21T07:58:00.952ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "84b83212-e30d-4804-bdb3-fcd2c311c384", "date": "Sat, 21 Dec 2024 07:58:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129472024-12-21T07:58:00.952ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129482024-12-21T07:58:00.954ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c0f9daa4-9135-4429-9ddb-90ec7ac37559", "date": "Sat, 21 Dec 2024 07:58:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129492024-12-21T07:58:00.954ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129502024-12-21T07:58:00.955ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129512024-12-21T07:58:00.955ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 288.358838ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
129522024-12-21T07:58:00.982ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b zone_address = fd00:1122:3344:101::2
129532024-12-21T07:58:00.982ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
129542024-12-21T07:58:00.982ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcf196bd-271e-4a38-98e8-1d638e2492a0", "content-length": "26", "date": "Sat, 21 Dec 2024 07:58:00 GMT"} })
129552024-12-21T07:58:00.982ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
129562024-12-21T07:58:00.984ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
129572024-12-21T07:58:00.986ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
129582024-12-21T07:58:00.992ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 325.375014ms iteration = 31 status = {}
129592024-12-21T07:58:01.045ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
129602024-12-21T07:58:01.045ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
129612024-12-21T07:58:01.045ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a657bcb-4ac8-47f0-a6c2-a2d51f86de2f", "content-length": "372", "date": "Sat, 21 Dec 2024 07:58:01 GMT"} })
129622024-12-21T07:58:01.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129632024-12-21T07:58:01.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129642024-12-21T07:58:01.047ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6a0e7a58-2637-4a0e-ad5c-2fea20148a6f dns_zone_name = oxide.test found_so_far = 1 version = 2
129652024-12-21T07:58:01.047ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
129662024-12-21T07:58:01.047ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 07:43:41.075205 UTC dns_group = external generation = 2
129672024-12-21T07:58:01.047ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 380.333797ms iteration = 17 status = {"generation":2}
129682024-12-21T07:58:01.049ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
129692024-12-21T07:58:01.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
129702024-12-21T07:58:01.051ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
129712024-12-21T07:58:01.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
129722024-12-21T07:58:01.053ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
129732024-12-21T07:58:01.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
129742024-12-21T07:58:01.055ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
129752024-12-21T07:58:01.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
129762024-12-21T07:58:01.057ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
129772024-12-21T07:58:01.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
129782024-12-21T07:58:01.058ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
129792024-12-21T07:58:01.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
129802024-12-21T07:58:01.060ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129812024-12-21T07:58:01.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
129822024-12-21T07:58:01.063ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
129832024-12-21T07:58:01.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
129842024-12-21T07:58:01.065ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
129852024-12-21T07:58:01.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
129862024-12-21T07:58:01.066ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
129872024-12-21T07:58:01.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
129882024-12-21T07:58:01.069ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
129892024-12-21T07:58:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
129902024-12-21T07:58:01.071ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
129912024-12-21T07:58:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
129922024-12-21T07:58:01.073ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
129932024-12-21T07:58:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
129942024-12-21T07:58:01.074ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
129952024-12-21T07:58:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
129962024-12-21T07:58:01.075ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129972024-12-21T07:58:01.076ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129982024-12-21T07:58:01.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
129992024-12-21T07:58:01.079ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130002024-12-21T07:58:01.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130012024-12-21T07:58:01.080ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
130022024-12-21T07:58:01.080ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130032024-12-21T07:58:01.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130042024-12-21T07:58:01.081ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3868b948-707b-4ae1-af35-f5b7c02c1500 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
130052024-12-21T07:58:01.081ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
130062024-12-21T07:58:01.081ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 07:43:39.444085 UTC dns_group = internal generation = 1
130072024-12-21T07:58:01.081ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 413.989207ms iteration = 17 status = {"generation":1}
130082024-12-21T07:58:01.081ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130092024-12-21T07:58:01.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130102024-12-21T07:58:01.082ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130112024-12-21T07:58:01.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130122024-12-21T07:58:01.084ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130132024-12-21T07:58:01.087ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
130142024-12-21T07:58:01.087ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130152024-12-21T07:58:01.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130162024-12-21T07:58:01.088ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
130172024-12-21T07:58:01.088ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
130182024-12-21T07:58:01.088ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "90ca5c2c-c6af-411c-b366-f093c6abbfa8", "date": "Sat, 21 Dec 2024 07:58:01 GMT"} })
130192024-12-21T07:58:01.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130202024-12-21T07:58:01.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130212024-12-21T07:58:01.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130222024-12-21T07:58:01.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130232024-12-21T07:58:01.092ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130242024-12-21T07:58:01.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130252024-12-21T07:58:01.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130262024-12-21T07:58:01.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130272024-12-21T07:58:01.094ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130282024-12-21T07:58:01.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130292024-12-21T07:58:01.095ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130302024-12-21T07:58:01.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130312024-12-21T07:58:01.097ZINFOnexus (BackgroundTasks): VPC route manager sled fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
130322024-12-21T07:58:01.097ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
130332024-12-21T07:58:01.097ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "16c8f821-591e-4e20-a10e-d7e0204f569c", "date": "Sat, 21 Dec 2024 07:58:01 GMT"} })
130342024-12-21T07:58:01.097ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130352024-12-21T07:58:01.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130362024-12-21T07:58:01.099ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130372024-12-21T07:58:01.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130382024-12-21T07:58:01.100ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 432.77165ms iteration = 33 status = {}
130392024-12-21T07:58:01.100ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130402024-12-21T07:58:01.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130412024-12-21T07:58:01.101ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130422024-12-21T07:58:01.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130432024-12-21T07:58:01.103ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130442024-12-21T07:58:01.106ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
130452024-12-21T07:58:01.106ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130462024-12-21T07:58:01.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130472024-12-21T07:58:01.108ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130482024-12-21T07:58:01.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130492024-12-21T07:58:01.109ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130502024-12-21T07:58:01.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130512024-12-21T07:58:01.110ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130522024-12-21T07:58:01.112ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
130532024-12-21T07:58:01.112ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c2144e2-d99d-43f4-a501-512c06ad3333", "content-length": "2", "date": "Sat, 21 Dec 2024 07:58:00 GMT"} })
130542024-12-21T07:58:01.114ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
130552024-12-21T07:58:01.114ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130562024-12-21T07:58:01.114ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
130572024-12-21T07:58:01.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130582024-12-21T07:58:01.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
130592024-12-21T07:58:01.114ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
130602024-12-21T07:58:01.115ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f36b6afa-177f-41f9-97da-45623b9614c6", "date": "Sat, 21 Dec 2024 07:58:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
130612024-12-21T07:58:01.115ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
130622024-12-21T07:58:01.116ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 448.712585ms iteration = 31 status = null
130632024-12-21T07:58:01.117ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6c3b51d2-8e80-4005-8a0b-046f5fd0a400", "date": "Sat, 21 Dec 2024 07:58:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
130642024-12-21T07:58:01.117ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
130652024-12-21T07:58:01.119ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "2dea0c91-9562-499a-97a7-015e44fefa18", "date": "Sat, 21 Dec 2024 07:58:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
130662024-12-21T07:58:01.119ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
130672024-12-21T07:58:01.121ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 1590b051-5b52-401c-b768-bbef4af00f89, kind: Service { id: bf6abf36-caab-412a-b734-038cee4a46b6 }, name: Name("nexus-bf6abf36-caab-412a-b734-038cee4a46b6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2a0ff22a-6a78-4cb0-b61d-38c999331844, kind: Service { id: e640ec59-1392-402a-8715-71c8bdc91537 }, name: Name("nexus-e640ec59-1392-402a-8715-71c8bdc91537"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 32])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd0592d1-5774-4ea2-8826-dec211cc7fec, kind: Service { id: a920b126-b55b-45c8-9984-5279bf662759 }, name: Name("nexus-a920b126-b55b-45c8-9984-5279bf662759"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 06368864-4b29-42bd-ae60-c6735712620d, kind: Service { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 }, name: Name("external-dns-b2ae004a-4c01-4dcf-8e90-49ba61c66084"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa85cda4-dfd2-46dc-aa66-9384e585dcaf, kind: Service { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 }, name: Name("external-dns-4dd95bbd-e009-486c-8c96-451a6e195a49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
130682024-12-21T07:58:01.121ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130692024-12-21T07:58:01.121ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
130702024-12-21T07:58:01.121ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 454.378889ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
130712024-12-21T07:58:01.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130722024-12-21T07:58:01.123ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130732024-12-21T07:58:01.123ZDEBGnexus (BackgroundTasks): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
130742024-12-21T07:58:01.124ZDEBGnexus (BackgroundTasks): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "634475d6-182a-49b8-89f4-6dd0b83e9602", "content-length": "691", "date": "Sat, 21 Dec 2024 07:58:01 GMT"} })
130752024-12-21T07:58:01.124ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
130762024-12-21T07:58:01.124ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
130772024-12-21T07:58:01.124ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
130782024-12-21T07:58:01.124ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
130792024-12-21T07:58:01.124ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
130802024-12-21T07:58:01.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
130812024-12-21T07:58:01.125ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 458.436707ms iteration = 32 status = {}
130822024-12-21T07:58:01.126ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
130832024-12-21T07:58:01.126ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 06368864-4b29-42bd-ae60-c6735712620d, kind: Service { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 }, name: Name("external-dns-b2ae004a-4c01-4dcf-8e90-49ba61c66084"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa85cda4-dfd2-46dc-aa66-9384e585dcaf, kind: Service { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 }, name: Name("external-dns-4dd95bbd-e009-486c-8c96-451a6e195a49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1590b051-5b52-401c-b768-bbef4af00f89, kind: Service { id: bf6abf36-caab-412a-b734-038cee4a46b6 }, name: Name("nexus-bf6abf36-caab-412a-b734-038cee4a46b6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2a0ff22a-6a78-4cb0-b61d-38c999331844, kind: Service { id: e640ec59-1392-402a-8715-71c8bdc91537 }, name: Name("nexus-e640ec59-1392-402a-8715-71c8bdc91537"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 32])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd0592d1-5774-4ea2-8826-dec211cc7fec, kind: Service { id: a920b126-b55b-45c8-9984-5279bf662759 }, name: Name("nexus-a920b126-b55b-45c8-9984-5279bf662759"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
130842024-12-21T07:58:01.126ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
130852024-12-21T07:58:01.183ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130862024-12-21T07:58:01.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130872024-12-21T07:58:01.186ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c42aa565-cfa0-40da-80f8-d11cd8222be9, rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fd9f8557-35f9-4ab6-a5bc-839cee3aec94) } rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
130882024-12-21T07:58:01.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130892024-12-21T07:58:01.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130902024-12-21T07:58:01.195ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
130912024-12-21T07:58:01.196ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "92648e69-a298-490f-8023-a0b143121846", "content-length": "134", "date": "Sat, 21 Dec 2024 07:58:00 GMT"} })
130922024-12-21T07:58:01.196ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
130932024-12-21T07:58:01.196ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fd9f8557-35f9-4ab6-a5bc-839cee3aec94
130942024-12-21T07:58:01.196ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
130952024-12-21T07:58:01.196ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
130962024-12-21T07:58:01.196ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
130972024-12-21T07:58:01.196ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
130982024-12-21T07:58:01.196ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
130992024-12-21T07:58:01.196ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
131002024-12-21T07:58:01.196ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131012024-12-21T07:58:01.196ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
131022024-12-21T07:58:01.197ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b
131032024-12-21T07:58:01.197ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131042024-12-21T07:58:01.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131052024-12-21T07:58:01.198ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
131062024-12-21T07:58:01.199ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e0bc0a5-2005-494c-9692-968411fed637", "content-length": "2", "date": "Sat, 21 Dec 2024 07:58:01 GMT"} })
131072024-12-21T07:58:01.199ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
131082024-12-21T07:58:01.199ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f6dd97e-8a86-4646-bb63-306948840f71", "content-length": "52", "date": "Sat, 21 Dec 2024 07:58:01 GMT"} })
131092024-12-21T07:58:01.199ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch_location = Switch0
131102024-12-21T07:58:01.199ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
131112024-12-21T07:58:01.239ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, time_created: 2024-12-21T07:43:34.995625Z, time_modified: 2024-12-21T07:43:34.995625Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
131122024-12-21T07:58:01.239ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
131132024-12-21T07:58:01.239ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
131142024-12-21T07:58:01.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
131152024-12-21T07:58:01.242ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
131162024-12-21T07:58:01.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
131172024-12-21T07:58:01.243ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131182024-12-21T07:58:01.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8, lookup_type: ById(fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) } result = Ok(())
131192024-12-21T07:58:01.278ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
131202024-12-21T07:58:01.292ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0abed160-b4f3-4399-bb56-558a51303c72", "date": "Sat, 21 Dec 2024 07:58:01 GMT"} })
131212024-12-21T07:58:01.292ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b switch = Switch0
131222024-12-21T07:58:01.292ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
131232024-12-21T07:58:01.292ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e92af880-4a9b-4c79-a3ae-829b6394cf0b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fb51d5d-518f-424d-9641-da723e0f166e", "content-length": "682", "date": "Sat, 21 Dec 2024 07:58:01 GMT"} })
131242024-12-21T07:58:01.292ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131252024-12-21T07:58:01.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131262024-12-21T07:58:01.296ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131272024-12-21T07:58:01.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131282024-12-21T07:58:01.298ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "50285a89-0825-419b-970a-7091660e6fcf", "date": "Sat, 21 Dec 2024 07:58:01 GMT"} })
131292024-12-21T07:58:01.299ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
131302024-12-21T07:58:01.299ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 632.113656ms
131312024-12-21T07:58:01.299ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 632.120987ms iteration = 4 status = {}
131322024-12-21T07:58:01.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131332024-12-21T07:58:01.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131342024-12-21T07:58:01.302ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131352024-12-21T07:58:01.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131362024-12-21T07:58:01.310ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 642.732654ms iteration = 31 status = {}
131372024-12-21T07:58:01.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d3f911f7-ad4c-46f7-b3b4-0c9d98f46b0b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131382024-12-21T07:58:01.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d3f911f7-ad4c-46f7-b3b4-0c9d98f46b0b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131392024-12-21T07:58:01.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = d3f911f7-ad4c-46f7-b3b4-0c9d98f46b0b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131402024-12-21T07:58:02.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 756fdece-1885-45da-88a7-72bc081fce10 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131412024-12-21T07:58:02.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 756fdece-1885-45da-88a7-72bc081fce10 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131422024-12-21T07:58:02.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 756fdece-1885-45da-88a7-72bc081fce10 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131432024-12-21T07:58:03.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b84dc8d2-2457-49b9-9f4e-2e7120cc32ab roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131442024-12-21T07:58:03.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b84dc8d2-2457-49b9-9f4e-2e7120cc32ab resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131452024-12-21T07:58:03.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = b84dc8d2-2457-49b9-9f4e-2e7120cc32ab response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131462024-12-21T07:58:04.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 87e2e221-74fc-499a-bcc7-219230b3a47a roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131472024-12-21T07:58:04.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 87e2e221-74fc-499a-bcc7-219230b3a47a resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131482024-12-21T07:58:04.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2671 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 87e2e221-74fc-499a-bcc7-219230b3a47a response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131492024-12-21T07:58:04.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 017de8c6-d01b-4bac-906b-62d9244000aa roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
131502024-12-21T07:58:04.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 017de8c6-d01b-4bac-906b-62d9244000aa resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
131512024-12-21T07:58:04.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 017de8c6-d01b-4bac-906b-62d9244000aa response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?sort_by=id_ascending
131522024-12-21T07:58:04.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 15f5762c-6104-4c30-b82e-a404550ae9d3 roles = RoleSet { roles: {} } uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
131532024-12-21T07:58:04.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 15f5762c-6104-4c30-b82e-a404550ae9d3 resource = Database result = Ok(()) uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
131542024-12-21T07:58:04.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36842 req_id = 15f5762c-6104-4c30-b82e-a404550ae9d3 response_code = 200 uri = /metrics/collectors/782bf979-9f7a-465e-8dc9-4ac9e0c82e87/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDE3ZTViMS0xZWU3LTQwM2UtOTM0Zi0zYzZlMjRjNWI5YzgifX0%3D
131552024-12-21T07:58:05.345ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:38980
131562024-12-21T07:58:05.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38980 req_id = 43524054-a2c4-4fab-aaff-650d05ea7797 roles = RoleSet { roles: {} } uri = /metrics/producers
131572024-12-21T07:58:05.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38980 req_id = 43524054-a2c4-4fab-aaff-650d05ea7797 resource = Database result = Ok(()) uri = /metrics/producers
131582024-12-21T07:58:05.382ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = e2e45dd6-1479-4aab-8030-3bcab95a4f4b
131592024-12-21T07:58:05.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37257 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38980 req_id = 43524054-a2c4-4fab-aaff-650d05ea7797 response_code = 201 uri = /metrics/producers
131602024-12-21T07:58:05.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = af427df8-0764-45cc-9b8d-569ae44f25d2 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131612024-12-21T07:58:05.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = af427df8-0764-45cc-9b8d-569ae44f25d2 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131622024-12-21T07:58:05.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = af427df8-0764-45cc-9b8d-569ae44f25d2 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131632024-12-21T07:58:06.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 158cf0a9-5c05-443d-a1fe-af0c720976d0 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131642024-12-21T07:58:06.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 158cf0a9-5c05-443d-a1fe-af0c720976d0 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131652024-12-21T07:58:06.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 158cf0a9-5c05-443d-a1fe-af0c720976d0 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131662024-12-21T07:58:07.393ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:42989
131672024-12-21T07:58:07.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42989 req_id = d56cd8f5-f901-4d05-ac75-d3422802480a roles = RoleSet { roles: {} } uri = /metrics/producers
131682024-12-21T07:58:07.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42989 req_id = d56cd8f5-f901-4d05-ac75-d3422802480a resource = Database result = Ok(()) uri = /metrics/producers
131692024-12-21T07:58:07.428ZINFOnexus: assigned collector to new producer collector_id = 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = nexus/src/app/oximeter.rs:76 producer_id = 5032d219-f3bf-40f5-8e36-efba904d39be
131702024-12-21T07:58:07.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34302 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42989 req_id = d56cd8f5-f901-4d05-ac75-d3422802480a response_code = 201 uri = /metrics/producers
131712024-12-21T07:58:07.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 603c6782-2b44-45ef-ba35-f4fd650a37e8 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131722024-12-21T07:58:07.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 603c6782-2b44-45ef-ba35-f4fd650a37e8 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131732024-12-21T07:58:07.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2583 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 603c6782-2b44-45ef-ba35-f4fd650a37e8 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131742024-12-21T07:58:08.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a588e287-4af7-4461-b9e8-3c679e680e56 roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131752024-12-21T07:58:08.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a588e287-4af7-4461-b9e8-3c679e680e56 resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131762024-12-21T07:58:08.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = a588e287-4af7-4461-b9e8-3c679e680e56 response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131772024-12-21T07:58:09.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1487 local_addr = [fd00:1122:3344:101::b]:53981 method = GET remote_addr = [fd00:1122:3344:101::d]:41090 req_id = 6303fd64-1137-4788-80a5-7fd643f322d5 response_code = 200 uri = /a920b126-b55b-45c8-9984-5279bf662759
131782024-12-21T07:58:09.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0b2b05af-84e5-4234-b2c1-858b5f4afacb roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131792024-12-21T07:58:09.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0b2b05af-84e5-4234-b2c1-858b5f4afacb resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131802024-12-21T07:58:09.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 0b2b05af-84e5-4234-b2c1-858b5f4afacb response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
131812024-12-21T07:58:10.667ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 92 reason = Timeout
131822024-12-21T07:58:10.667ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 92 reason = Timeout
131832024-12-21T07:58:10.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131842024-12-21T07:58:10.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131852024-12-21T07:58:10.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131862024-12-21T07:58:10.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131872024-12-21T07:58:10.669ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131882024-12-21T07:58:10.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131892024-12-21T07:58:10.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131902024-12-21T07:58:10.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
131912024-12-21T07:58:10.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131922024-12-21T07:58:10.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131932024-12-21T07:58:10.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131942024-12-21T07:58:10.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131952024-12-21T07:58:10.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131962024-12-21T07:58:10.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b, lookup_type: ById(5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b) } result = Ok(())
131972024-12-21T07:58:10.679ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131982024-12-21T07:58:10.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131992024-12-21T07:58:10.693ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b original_time_created = 2024-12-21 07:42:48.478631 UTC target_id = 5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b time_created = 2024-12-21 07:42:48.478631 UTC
132002024-12-21T07:58:10.693ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.252307ms iteration = 92 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5c73c6ab-f46d-4d76-aacf-fa9e22bb8a9b","time_created":"2024-12-21T07:42:48.478631Z"}
132012024-12-21T07:58:10.704ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.762202ms iteration = 92 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
132022024-12-21T07:58:10.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 90ce605b-6b6d-4cb0-bdbe-3ffef06ace1b roles = RoleSet { roles: {} } uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
132032024-12-21T07:58:10.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 90ce605b-6b6d-4cb0-bdbe-3ffef06ace1b resource = Database result = Ok(()) uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
132042024-12-21T07:58:10.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:59071 req_id = 90ce605b-6b6d-4cb0-bdbe-3ffef06ace1b response_code = 200 uri = /probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8